Closed

Website Spider / Data Collector

Website Spider / Data Collector

I want a program that will spider a selection of YouTube type sites and save the thumbnail, and video page URL, and collect the title and run-time of every video on every sites we choose to spider. This data is to be saved to MySQL.

I want to scan the sites often to keep up with updates, so i only want to collect new URL's. I want an update feature that will scan old URL's and make sure the same video is still there and working.

This is to be a command line script to run on crontab.. System is FreeBSD 6.1

Skills: C Programming, Data Processing, Perl, PHP, Python

See more: type a scan, spider, freebsd, cgi video, mysql save data, php collect data website, php run command, video website system, php mysql video thumbnail, data time, collect data website script, youtube collect data, title video url title youtube, data program, run website, data type website url, url spider, url video website, save data website, sites collect data, Scan Type, youtube website php, data collector spider, collect data website php, youtube video data url

About the Employer:
( 124 reviews ) Woodland Hills, United States

Project ID: #230769

11 freelancers are bidding on average $836 for this job

creatorul

Professional work.

$1500 USD in 15 days
(146 Reviews)
7.5
MAnkita

Hello,Please refer your [url removed, login to view] you.

$800 USD in 7 days
(122 Reviews)
7.0
winterspade

Ready to work for you. Please see PMB for more detail . Thanks

$750 USD in 4 days
(48 Reviews)
6.9
cliver

Hello, Please look at the PMB. Thanks, Sergey

$750 USD in 5 days
(38 Reviews)
6.9
kernelbd

Ready to start, we can do this. Thanks.

$750 USD in 5 days
(107 Reviews)
6.8
hsoft

I am having more than 5 year of experience. I can easily do this job.

$750 USD in 5 days
(34 Reviews)
6.4
RenesansSoftware

Hello. Please read pm.

$750 USD in 10 days
(9 Reviews)
4.4
yuriiz

Hi, I can do this in Python.

$750 USD in 5 days
(12 Reviews)
4.2
maxk

Hello, My name is Max. I just came across your post on GetAFreelancer and I know I'm the right person for the job. With over a decade of programming experience, as well as extensive prior experience building scrap More

$900 USD in 5 days
(10 Reviews)
4.2
naivatco

We can do it. We are new just on GAF... Thank you.

$750 USD in 3 days
(0 Reviews)
0.0
jozoppi

I've already done a crawler in my past using Lucene for Wikipedia Indexing as you can see at: [url removed, login to view]

$750 USD in 10 days
(0 Reviews)
0.0