Closed

Web Scraper for a paginated search page

This project was awarded to card123vw for $50 USD.

Get free quotes for a project like this
Employer working
Awarded to:
Skills Required
Project Budget
$30 - $250 USD
Total Bids
21
Project Description

I want to retrieve results from the newspaper [url removed, login to view]
The website has an advanced search [url removed, login to view] that allows you to input a query and a time frame and it outputs the articles matching the query in a paginated results.
The final product would be a script in which I can simply enter multiple keywords an one time frame and get back the number of results per keyword and also save a file in my desktop with the titles, dates and url of these articles. I would also be able to enter a boolean keyword like keyword1 AND keyword 2. I am only interested in the AND operator.
Example:
Input:
Keywords: Egypt, Oman, Syria
Time Frame: 01-01-2011 to 12-01-2011
Output:
123 articles for Egypt
55 articles for Oman
300 articles for Syria
and a csv file is saved with the date, url and title of the articles.

I would love it to be a python script but any other language is fine too.
Thanks

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online