I need a scraper that will store completed auction data from [login to view URL] ([login to view URL]). It will need to scrape and save the Item name, winning bidder, final price, and date/time of auction ending. Also, as long as this does not put too much stress on the site, I would like to scrape information located on the actual auction page (Value Price, Placed Bids, Voucher Bids, Savings, and Delivery Cost)
This scraper must not collect duplicate information. I would like the process to be fully automated. Ideally I could just set up a cron job, or configure the program itself to run all day (assuming it doesn't put too much stress on the site)
If possible, I would also be interested in any means of organizing/interpreting the data (freeware or simple programmable solution.)
*Please let me know if I will need to worry about my IP getting blocked
*If possible, I would like the source code - the only reason I ask is programs I purchase through this site tend to be buggy and I would like to have a chance to fix the software should it give me problems.
*Will need to either ensure me that it will almost never crash, or if it does crash it will be able easily restart w/out collecting duplicate information
*Specifics - I'm flexible on all of this, so if you would like to use a different OS, programming language etc... please let me know and we can discuss it:
*OS - Windows 7
*Code - Visual Studio (Ideally C# but VB is fine)
hi. We are highly experienced on crawlers, we specialize in data-mining software, extracting a variety of information from different sources, yellow pages, google, craigslist, classified sites, others. Our price: $ 115 to code it. Please see PMB for details