Event and Artist data scraping

IN PROGRESS
Bids
12
Avg Bid (USD)
$834
Project Budget (USD)
$250 - $750

Project Description:
Need a script that will grab events from a number of sites and put them into a common database. Along with events also venues, artists, promoters and other data will need to be gathered and stored/updated in a consistent way.

The script will scrape events along with media and metadata from 3-4 different sites and consolidate them into one database. The data will be merged and dupe checked. Some data can be gathered via API and RSS, other will be scraped from websites. You will need to come up with a flexible data structure to cover multiday events, recurring events etc. The scraper should be configurable for spreading requests out over time to not overload servers etc.

A password protected backend is needed to view and filter logs/statistics as well as view/edit/approve/remove events/data. The backend needs to support an approval queue for merged and imported data. There should be an admin function to add events manually as well.

There should be an API to access all the data.

Automated status emails should be sent to the admin on a configurable address.

A frontend is needed to view and filter the data, with very fast search and realtime updating w node.js/jquery/mootools/ajax or similar.

Not cut and paste bids, please be specific about experience with data scrapers and similar projects.

Skills required:
Data Processing, PHP, Ruby on Rails, SQL, Web Scraping
About the employer:
Verified
Public Clarification Board
Bids are hidden by the project creator. Log in as the employer to view bids or to bid on this project.
You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.


Hire rajeshsonisl
$ 2061
in 10 days
$ 475
in 12 days
$ 1442
in 30 days
$ 578
in 9 days
$ 721
in 10 days
$ 680
in 10 days
$ 1237
in 10 days
$ 526
in 10 days
$ 500
in 12 days
Hire texdevelopers
$ 488
in 10 days