Script Crawler/Scraper for Craigslist and Kijji

  • Status Closed
  • Budget N/A
  • Total Bids 12

Project Description

I require a simple program that has a user friendly interface with simple boxes I can fill in with text or drop down boxes that allows me to alter the variables.

Scrapes Craigslist and Kijiji at a regular interval for the data below (time intervals must be controllable by me)

Search criteria (I want boxes I can fill with text for these)

-Multiple cities/regions of my choosing must be continually scraped at the interval of my choosing as listed above

-Multiple categories of my choosing must be searched at same time (example: 'used cars' AND 'for sale/buying' from kijiji at same time etc...)

-Multiple keywords at same time (example: 'iphone' AND 'or best offer' etc...)

-Multiple keywords must also be able to be OMMITTED from search results (example: I may want to search for the term 'negotiable' but omit results that say 'NOT + negotiable'. I also want to be able to omit items from kijiji that have 'WANTED:' next to them.)\

-Search results older than a set date of my choosing are also omitted (this isn't very important if it is difficult to do)

Search result layout

-Results MUST be possible to list in order category (example: cars, phones) and in order of preference WITHIN said category (example: within the category of 'PHONES' if 2 searches are performed at the same time 'iphone + 16gb' and 'iphone + 32gb' , I want to indicate which results I want placed higher in priority on my 'PHONES' results list. In this example, I may want the results from the 'iphone + 16gb' listed before I see 'iphone + 32gb')

-Results after sorting merely need to be displayed as they are on craigslists/kijiji website - simple titles - I will read the titles and click on them to read the description further if I so desire. Clicking on said titles will bring me to the description on their website, whereby I can contact the user.

-I want to be updated via alerts somehow through my phone. If a certain item that I am searching for that meets my search criteria comes up I want it to notify me somehow (especially if it is in my higher criteria area)

Get free quotes for a project like this

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online