In Progress

VB.Net Multithreaded Web Scraper

I need multithreaded VB.Net source that scrapes like this:

1. Pick urls from a list (can be from a list of any kind - you make it up. From a text file or an array or a database - not important)

2. Go and scrape each url. No need to save the contents of the scrape - I am just interested in the overall logic and how the multithreading works.

I'd like to be able to set the number of simultaneous threads.

The scraping should show how to use the most basic scrape (i.e. no javascript support) as well as using Watin - both in multithread. I already know how Watin works - I've just never multi threaded it.

If you plan to use any commercial library, I need to know beforehand so I know the cost.

I use Visual Studio 10 and Windows 7 x64 and the source must run on this.

Skills: .NET, Web Scraping

See more: visual basic multithread scraper, multithread scraper, simultaneous web scrape, multithreading web scraping, visual web scraper, watin multithreaded, multithread scraping, web d cost, visual basic net array, vb.net if, vb net array, using array in vb net, use of vb net, use in vb.net, if vb net, how to use vb net, how to use in vb.net, web scraping library visual studio, watin multithread, multithreaded web scraper, vb.net list, vb.net, multi-threaded, list vb.net, e vb

About the Employer:
( 13 reviews ) Box Hill, Australia

Project ID: #1589761

Awarded to:

tamrakar81

Hi, I have gone through your requirement and I am glad that We can accomplish this task,as I have ready mutlithreaded scraper . Only I need to make some changes for you . Please give us opportunity to work with More

$175 AUD in 1 day
(33 Reviews)
5.0

7 freelancers are bidding on average $214 for this job

CodeGuru123

Please check my message.

$250 AUD in 2 days
(48 Reviews)
6.9
geekydeveloper

Hello Mate, We have 6 years of experience of core development and we have Experienced team. Please check our PMB for brief details.

$235 AUD in 5 days
(23 Reviews)
6.4
koolsidz

Vb.net Whiz here. Please see PMB

$250 AUD in 0 days
(12 Reviews)
3.8
TheOneInfo

Hi, I have very good experience in web scrapping. I can do this. Please check PM for more details.

$200 AUD in 7 days
(2 Reviews)
3.1
NightCoders

i can easily do this job. kindly go through my resume.i am also sending you my previous [url removed, login to view] go through that.

$230 AUD in 5 days
(1 Review)
3.0
pradeep1210

Hello :) I have different web scrapers ready for your perusal. I am an expert in web scraping and building web scrapers.

$160 AUD in 0 days
(2 Reviews)
1.9
U3j54ILXi

Pls check PMB.

$250 AUD in 1 day
(0 Reviews)
0.0