Web Crawler

This project received 11 bids from talented freelancers with an average bid price of $188 AUD.

Get free quotes for a project like this
Project Budget
$30 - $250 AUD
Total Bids
Project Description

Requires someone to create a web crawler so crawl nominated sites and capture product information

The web crawler would be used everyday and new products would be inserted into the database whereas existing products would be updated if there is any


Site Name

Product URL Link

Product Title



Specials (If any)

Product Descriptions

Images URL

And then put these information into a database (MYSQL)

Much like how [url removed, login to view] works (but more internally for own use as point of reference)

the idea is for price comparison and reporting to compare between different sites

Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online