Build an E-commerce site crawler

Avg Bid (USD)
Project Budget (USD)
$30 - $250

Project Description:
I need a custom crawler than can crawl 10,000s of pages from an e-commerce site (single domain) to collect the necessary product/pricing information that can be presented back in an XML file and Excel file format. I need to then integrate this file to my e-commerce site to add the necessary information to my product pages. I don't have my site ready yet but I will have to get the integration done based on the data I can get from the crawler. The crawler will also have to login to the website first before crawling the pages as the key information on the pages are only available when logged-in.

There are lots of open source software in the market than can be used to build this crawler so ideally I don't want to pay anything on an on-going basis. But I am happy to discuss the additional cost based on the platform that you suggest using, What I want is someone experienced to create the custom code for the crawler, ensure the data is collected and presented the way I need. I have to use the crawler on a weekly basis to crawl the pages and collect the data.

I can provide any more details that you need if you are interested in this project. Previous experience with creating web crawlers is a must. And I need this to be delivered within a week from the start date


Skills required:
Anything Goes, PHP, Software Architecture
About the employer:
Public Clarification Board
Bids are hidden by the project creator. Log in as the employer to view bids or to bid on this project.
You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.

Hire enderium
$ 50
in 2 days
$ 180
in 6 days
$ 250
in 3 days
Hire renanreis
$ 60
in 5 days
$ 200
in 10 days
Hire itconsultindia
$ 400
in 4 days
$ 300
in 5 days
$ 250
in 15 days
Hire kdeveloper5
$ 500
in 7 days