Completed

VB.Net Multithreaded Web Scraper

This project was successfully completed by tamrakar81 for $175 AUD in a day.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
$30 - $250 AUD
Completed In
1 day
Total Bids
8
Project Description

I need multithreaded [url removed, login to view] source that scrapes like this:
1. Pick urls from a list (can be from a list of any kind - you make it up. From a text file or an array or a database - not important)
2. Go and scrape each url. No need to save the contents of the scrape - I am just interested in the overall logic and how the multithreading works.

I'd like to be able to set the number of simultaneous threads.

The scraping should show how to use the most basic scrape (i.e. no javascript support) as well as using Watin - both in multithread. I already know how Watin works - I've just never multi threaded it.

If you plan to use any commercial library, I need to know beforehand so I know the cost.

I use Visual Studio 10 and Windows 7 x64 and the source must run on this.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online