I am in need of an extremely quick method to grab the source code of a web page. I'd like this developed in VB.NET. With a normal webbrowser control, I'm averaging maybe one page in .25 seconds. With the webhttprequest object, I'm averaging about 2-3 seconds per page. I need a method that can grab the source code of a page in less than .1 seconds (100ms). And, it must not freeze up the program while it's operating. (the webhttprequest approach will actually freeze up the program that it's running on until the process has completed) If your method can successfully do 30,000+ links/hour with a single instance of it running, then consider your method the winner. Of course, if you could do 50,000+ or even 75,000+ links/hour, that would be even better. I must also be able to run more than one of these at a time. I may want to run 6 or even up to 10 of these at once, so the method must NOT be a resource hog.
If you think you have a method that fits the above criteria (grabbing the source code of 30,000+ pages/hour (example page - [url removed, login to view]), can have multiple instances running at once, and is not a resource hog), then please present it to me.
Thanks, and I look forward to your bids, everyone!
P.S. - It's preferred that you have an already-made solution. I don't have a large budget for this specific project, however you will have much, much more work in the near future.