Web Scraping App using Ruby or Curl

This project was successfully completed by rinsadsl for $350 USD in 5 days.

Get free quotes for a project like this
Employer working
Completed by:
Project Budget
$250 - $750 USD
Completed In
5 days
Total Bids
Project Description

This project will involve web scraping with either Ruby or Curl.

I will provide information about a web API which can be accessed with Ruby or Curl to produce a list of academic references (either 1 or an arbitrary number of references).

Those references should be passed online to Google Scholar. In turn Google Scholar will in some cases locate a PDF document vs. an HTML document vs. a website link. The output of the web scraping App should be a set of PDF or HTML documents corresponding to the output from Google scholar. These documents should be placed in a specified Folder in Mac OS.

As a bonus, a developer who is familiar with DevonThink would write this as a DevonThink script, with the output as PDF or HTML or web link documents in the Devonthink Inbox.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online