Data extraction/crawling from yelp and opentable

CLOSED
Bids
21
Avg Bid (USD)
$654
Project Budget (USD)
$250 - $750

Project Description:
Hello, I need a web crawler to download and parse data from www.yelp.com/ and www.opentable.com. Mainly the product ratings, text and reviewer characteristics. You can send me the csv files or sql database file.

You will first need to match restaurants for the two websites in 6 major cities: New York, LA, Chicago, Houston, Philadelphia, Pheonix
After achieving matches, you will need to download variables such as ratings.

Variables to download (Yelp):
(a) Merchant Data: merchant name, website URL, Zip code, State, city, hours of operation, business website URL, parking, wifi, merchantID

(b) Review Data: Repeated for the same merchant (sort by time stamp): time stamp, rating, text, words, check-in, useful, funny, cool, reviewID, reviewerID

(c) Reviewer Data: number of friends, number of reviews, number of tips, number of fans, number of local photos, tenure (months since join), location (state and city), average of ratings (may be difficult), elite, reviewerID

Variables to download (opentable):
(a) Merchant Data: merchant name, website URL, merchantID

(b) Review Data: Repeated for the same merchant (sort by time stamp): time stamp, overall_rating, food_rating, ambiance_rating, service_rating, text, words, helpful, unhelpful, reviewID, reviewerID

(c) Reviewer Data: review count, first review date, featured reviews, average rating, reviewerID

Feel free to ask any questions.

Skills required:
Java, MySQL, PHP, Software Architecture
About the employer:
Verified
Public Clarification Board
Bids are hidden by the project creator. Log in as the employer to view bids or to bid on this project.
You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.


$ 360
in 5 days
$ 742
in 8 days
$ 515
in 10 days
Hire marchent
$ 732
in 10 days
$ 505
in 5 days
Hire stdhtelkom
$ 515
in 10 days
Hire aoefmpes
$ 370
in 10 days
Hire richammond
$ 750
in 9 days
$ 789
in 10 days
$ 526
in 10 days