Closed

News Website Scraper

This project received 19 bids from talented freelancers with an average bid price of $535 USD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
$250 - $750 USD
Total Bids
19
Project Description

I am looking to build a scraper that pulls in news feeds from various sites and also twitter and facebook feeds. The scraper should be able to look a news sites, pull the title, main image, first 200 words, category, date, and URL of the news stories. It should then store them in a database and allow me to view and read through them on a single url. To access the data, I should be able to log into a password protected area that allows me to see all sorted by most recent date or select a category or specific date range. I should also be able to search through them by keyword. The scraper will scrape 20 different websites and will run every 5-10 minute interval or any interval I define.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online