In Progress

200+ site screen scraper for single product comparison

I want the framework for a multi site scraper written so I can get the price, description, link and availability (in-stock/out of stock) of a single product that is sold on 200+ sites. Preferably, it would use CSS/jquery selectors to find the text to scrape.

I need to be able to put the links in to the pages to be scraped in myself and also the selectors. I would like the scraper to run on a schedule and output the data in SQL. I need the format in columns, with as many rows as there are pages to be scraped. The columns would be "id, description, price and status". The main thing is that I can select what selectors text from each site goes into what column and that it can be a different selector on every row. I understand manually going through 200+ sites to find on where their price information for 1 product is kept will be a lot of work, but it will be me doing it. I already started it using pjscrape, but I can't get all the data from multiple sites organized.

Skills: Data Mining, jQuery / Prototype, PHP, Software Architecture

See more: jquery product scraper, architecture site, screen scraper, scrape for links, product selector, product comparison, screen scraper php, price comparison scraper, find product description, jquery multi, jquery stock, 200 multiple, jquery quot, jquery columns run, need stock lot, jquery find links, multi jquery php, scrape data sql, php schedule jquery, pjscrape, php scraper 2013, price comparison sites work php, php schedule output, product scrape, select multiple jquery

About the Employer:
( 1 review ) Fort Collins, United States

Project ID: #4159527

Awarded to:

gbarco

I suggest a slightly different approach to this project which I explain via PM.

$130 USD in 7 days
(14 Reviews)
4.5

5 freelancers are bidding on average $184 for this job

mantislin

Hi sir, please check PM, thx Kimi.

$248 USD in 5 days
(136 Reviews)
6.6
techwelf

Hi we checked your requirement,We could develop as per your need. u could check that out. we would work till your satisfaction. Thanks & Regards Techwelfare Please check inbox for our previous work.

$244 USD in 10 days
(36 Reviews)
5.7
saobiensoft

Do you accept java? If not, please ignore my bid.

$50 USD in 5 days
(4 Reviews)
3.0
getveltrod

Hi, Veltrod Software services is a global software consulting company specialized in providing Mobile applications, Social media frameworks and eCommerce solutions. Leveraging best-in-class people, processes, and te More

$250 USD in 15 days
(5 Reviews)
1.3