Basic Webpage Spider Crawler Script

In Progress Posted Nov 24, 2013 Paid on delivery
In Progress Paid on delivery

I am looking for a reliable developer who has a passion for development. This will be an ongoing project with multiple iterations / stages towards building a larger project.

We would like to build a simple webpage crawler script. The purpose of the crawler is to crawl specific websites for very basic information and then spit the desired data out as a simple xml file.

It should work as follows:

Example:

1. Crawler's Subject matter in this example will be shoes

2. Admin will create a set of categories categories

2. Admin user can Enter the desired site to crawl

3. The Crawler will crawl the chosen site

4. The Crawler will pull the data and organize the information into the appropriate categories (based on its data)

5. The Data will be stored in either an XML, CSV or what ever solution is be best for pulling the data QUICKLY and on the fly.

6. Information that will be pulled will be: "Category(s), Product Name, Product #, Size, Color(s), Price, Website, Product image URL, Product URL"

This info will be stored and frequently checked against for updates (via the crawler).

This will be use for 100s of sites.

Thanks!

HTML PHP Python WordPress XML

Project ID: #5161441

About the project

19 proposals Remote project Active Dec 2, 2013

Awarded to:

zainbasharat

Hi Sir i have experience in web scrapping and i am interested in your project. i am new to freelancing but you can see my reviews from previous clients. please provide me more details about the project. i can make cus More

$55 CAD in 2 days
(4 Reviews)
2.0

19 freelancers are bidding on average $406 for this job

pytho

A proposal has not yet been provided

$258 CAD in 8 days
(35 Reviews)
6.7
ddhnyh1

Hi. I can help you with python. I have a good experience in python. Over the last 6 years, I have developed a lot of applications I have wide experience in the following areas: Python, HTML, Javascript, CSS. You c More

$222 CAD in 3 days
(25 Reviews)
5.5
NTechcorporate

Dear Cleint, Hope you are doing well !!!! Thank you for posting this job, We have gone through your requirement specification and confident to deliver you best "Python" solution as we have expert in-house team of More

$242 CAD in 7 days
(4 Reviews)
5.0
Handyman84

A proposal has not yet been provided

$386 CAD in 9 days
(5 Reviews)
4.7
seomaster212

Hi sir i am ready for work kindly check pm. Hi sir i am ready for work kindly check pm. Hi sir i am ready for work kindly check pm.

$824 CAD in 20 days
(20 Reviews)
4.1
mtavartkiladze

A proposal has not yet been provided

$2631 CAD in 15 days
(14 Reviews)
4.0