In Progress

Need a crawler made to capture product details & store in database

This is the full requirement of the Web Crawler:

1) Products to be picked from every online store that exists on the web. Web Stores would be automatically searched.

2) Products would have to filtered as per Category/Sub-category (The Category/Sub-category taxonomy will be provided)

3) The products would also be filtered by brands so that the Products can be tagged with their respective Brands

4) The data collected would have to be structured so that the main attributes of the Products can be filtered using those attributes/parameters.E.g Price, Accurate Key words, Stores, Url of store, Advanced Search options.

5) The Crawler should be able to distinguish between Online Webstores and websites

I'm attaching the current database structure screen-shots which will help you understand that the current database is unstructured for any kind of search due to the lack of proper attributes.

The crawler would be setup on a Cloud server with cron job or something similar concept so that it works continuously to search online stores and add product data into a MySQL database.

Please let me know what you can do & what would be the time-frame to do this. Please only experienced people who understand and are confident they can handle this should apply. If you cannot show previous experience with crawling scripts please do not bid.

Skills: Anything Goes, MySQL, PHP, Software Architecture

See more: web crawler job search, web crawler architecture, structure stores, online web crawler, online architecture job, key data structure, job web crawler, frame store, data structure concept, concept data structure, architecture web crawler, architecture job online, screen capture online, online data capture, taxonomy, product details, price crawler, people need web, database crawler, data crawler, crawler, cloud database, add product category, mysql product search, web data crawler

About the Employer:
( 4 reviews ) Kolkata, India

Project ID: #2564810

6 freelancers are bidding on average $1342 for this job

BackSlaSh85

I'm interested.

$1500 USD in 10 days
(10 Reviews)
5.1
X1r8N6zUW

Custom software development: w w w . The Administrator removed this message for containing contact details which breaches our Terms of Service . i o

$1500 USD in 1 day
(0 Reviews)
0.0
mohet

Hello... I have been working on web development field over a year and have completed many projects till date. Here are few of the links that i have worked upon. www.trueemrtechnologies.com More

$800 USD in 18 days
(0 Reviews)
0.0
yzcrawler007

Hello, please check PMB, let's talk about details.

$1250 USD in 12 days
(0 Reviews)
0.0
D3QAj1g2R

Custom software development: w w w . The Administrator removed this message for containing contact details which breaches our Terms of Service . i o

$1500 USD in 1 day
(0 Reviews)
0.0
exlcoder123

Hi, We are highly experienced developers with similar development expertise. We assure you that your work will be done according to your requirement with best quality. Please view Private Message Board for more det More

$1500 USD in 30 days
(0 Reviews)
0.0
vineetdcosta6

"WE HAVE SCRIPT READY FOR YOU" We are expertise in creating scraper, crawler, extractor & many more..We are new in freelancer so we don't have review here but we have reviews in other freelancing sites..Please check P More

$1250 USD in 7 days
(0 Reviews)
0.0