** PLEASE READ BEFORE BIDDING **
This project is to build a standalone piece of software which will scrape a particular website for particular data, and save the results to a .csv file. I will specify exactly how the site should be scraped, and how the results should be saved.
To do the web scraping, the software will need to answer captchas. I don't believe these are particularly difficult on the site I'm interested in, and I can provide you with samples if necessary. I am open to various methods for solving them -- pure software preferred, but human solver networks are also possible if the cost is low enough. ***In your bid, please tell me specifically how you plan to answer the captchas.**
Features of the needed program:
- Performs an initial scrape to populate search options, which the user then decides among.
- Performs a "full" scrape based on the chosen options (there are about 10 steps to be performed repeatedly, including solving captchas)
- Runs as an application, or from the command line (must be very simple to run on a new machine, and any preparation such as downloading libraries should be executed in the program itself)
- Mac app or Bash command line program preferred, but Windows OK too (let me know which you can do)
- Can run on user's command, and also has scheduling ability (can set dates & times, or pre-specified schedules like daily at a particular time)
- I require the source code of the program (in case I want to make changes/additions in the future in an area outside your expertise)
- It's a plus if the program can detect changes from the last scrape and notify the user of these.
- It's a plus if the program can email the output .csv and the changes (from above) to a specified email address automatically
If you need more information to give an accurate bid, please message me.
Thanks for reading!
12 freelancers are bidding on average $434 for this job
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
I've done many scraping jobs here and a couple of them required solving a captcha. Please let me know the website you want to scrap and the captcha that needs to be solved.