I need multithreaded [url removed, login to view] source that scrapes like this:
1. Pick urls from a list (can be from a list of any kind - you make it up. From a text file or an array or a database - not important)
2. Go and scrape each url. No need to save the contents of the scrape - I am just interested in the overall logic and how the multithreading works.
I'd like to be able to set the number of simultaneous threads.
If you plan to use any commercial library, I need to know beforehand so I know the cost.
I use Visual Studio 10 and Windows 7 x64 and the source must run on this.