Web scraping / captcha solving / output csv report

  • Status Closed
  • Budget $30 - $250 USD
  • Total Bids 12

Project Description


This project is to build a standalone piece of software which will scrape a particular website for particular data, and save the results to a .csv file. I will specify exactly how the site should be scraped, and how the results should be saved.

To do the web scraping, the software will need to answer captchas. I don't believe these are particularly difficult on the site I'm interested in, and I can provide you with samples if necessary. I am open to various methods for solving them -- pure software preferred, but human solver networks are also possible if the cost is low enough. ***In your bid, please tell me specifically how you plan to answer the captchas.**

Features of the needed program:

- Performs an initial scrape to populate search options, which the user then decides among.

- Performs a "full" scrape based on the chosen options (there are about 10 steps to be performed repeatedly, including solving captchas)

- Runs as an application, or from the command line (must be very simple to run on a new machine, and any preparation such as downloading libraries should be executed in the program itself)

- Mac app or Bash command line program preferred, but Windows OK too (let me know which you can do)

- Can run on user's command, and also has scheduling ability (can set dates & times, or pre-specified schedules like daily at a particular time)

- I require the source code of the program (in case I want to make changes/additions in the future in an area outside your expertise)

- It's a plus if the program can detect changes from the last scrape and notify the user of these.

- It's a plus if the program can email the output .csv and the changes (from above) to a specified email address automatically

If you need more information to give an accurate bid, please message me.

Thanks for reading!

Get free quotes for a project like this
Awarded to:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online