We need about 40 crawlers/scrapers for different web sites to be written and maintained

Closed

Description

We need about 40 crawlers/scrapers for different web sites to be written and maintained for at least 12 months.

Crawlers/Scrapers should be written in .NET (With Source Code presented) and have the following setup fields and control functions/buttons

• Web Site crawled

• Current URL

• Mode (Detailed/List)

• Number of URLs crawled

• Number of Products Crawled

• Start/Stop/Exit/Restart

• Crawling Time

• Proxy List File Path (in csv format)

• Load new Proxy List

• User Agent setting Configuration

• Random Delay between URLs setting (From/To sec)

All Bids should be done as per 1 Crawler/Scraper.

All crawlers/scrapers should internally use SQLSever2008 or MySQL database and have 2 crawling modes:

1. Detailed with the following information extracted from Product Details Page and output in SQLSever2008 or MySQL Database and XML file Format

2. List With the following information extracted from Product List and output in SQLSever2008 or MySQL Database and XML file Format:

Skills: .NET, Engineering, MySQL, Software Testing, Visual Basic

See more: Web Scrapers, web crawlers, visual web scraper, net crawler source code, setup proxy scraper, products scraper net, basic web scraper, net xml functions, mysql load csv file, mysql xml output, web scraper proxy, xml csv net, net number format, web sites list, random list urls, crawler scraper xml mysql, use proxy list, need sec, web crawler details, web scraper source, scraper xml, page mysql output, net csv database, product crawler code, basic web crawler

Project ID: #3984233

Awarded to:

MSGuys

Will be able to do each scrapper quickly in .NET/C#. Please check PM.

$50 USD in 3 days
(4 Reviews)
4.5

12 freelancers are bidding on average $117 for this job

sharpsoft

For more details please check PM

$120 USD in 1 day
(3 Reviews)
7.8
novepi

The requirements are pretty clear so I don't have any questions.I'll probably have some though once the sites list is provided so if you can answer within 24 hours that'd help a lot in development, thanks.

$100 USD in 3 days
(25 Reviews)
5.4
ibbuzz

I have done crawler and scrapper work before. Check PM

$150 USD in 365 days
(34 Reviews)
4.7
jitendraparmar07

Expert scrapper here. Will complete the bot in just 5 hours and then start scrapping.Please check your PMB.

$120 USD in 0 days
(7 Reviews)
4.2
aoefmpes

pl check your inbox

$100 USD in 5 days
(7 Reviews)
4.0
ArsenMkrt

Hi, You can find a lot of simular crawler services done in my allready done works list. Please provide sample url that need to be crawled, and let me know if you want to see demo before accepting bid

$120 USD in 7 days
(9 Reviews)
3.9
tassaduqvw

Please see your inbox for message.

$30 USD in 3 days
(9 Reviews)
3.6
ibraars

Please see PMB

$60 USD in 2 days
(2 Reviews)
2.2
ronnie173

I can make crawlers for you using winforms or wpf.

$80 USD in 7 days
(0 Reviews)
0.0
ideadezigner

Please check PMB

$100 USD in 3 days
(0 Reviews)
0.0
renersilv

Hi, I have over 8 years of experience in .NET C#. Please, can you give me more details about this job?

$200 USD in 10 days
(0 Reviews)
0.0
ebizworld1

Dear sir, I have implemented web and application about crawler/index/SE before. So with my experiences, I can finish that for you and may make long term relationship with your side. Thanks,

$200 USD in 7 days
(0 Reviews)
0.0