Web Scraper for a paginated search page

  • Status Closed
  • Budget $30 - $250 USD
  • Total Bids 21

Project Description

I want to retrieve results from the newspaper [url removed, login to view]

The website has an advanced search [url removed, login to view] that allows you to input a query and a time frame and it outputs the articles matching the query in a paginated results.

The final product would be a script in which I can simply enter multiple keywords an one time frame and get back the number of results per keyword and also save a file in my desktop with the titles, dates and url of these articles. I would also be able to enter a boolean keyword like keyword1 AND keyword 2. I am only interested in the AND operator.

Example:

Input:

Keywords: Egypt, Oman, Syria

Time Frame: 01-01-2011 to 12-01-2011

Output:

123 articles for Egypt

55 articles for Oman

300 articles for Syria

and a csv file is saved with the date, url and title of the articles.

I would love it to be a python script but any other language is fine too.

Thanks

Get free quotes for a project like this
Awarded to:
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online