Script Crawler/Scraper for Craigslist and Kijji
This project received 12 bids from talented freelancers with an average bid price of $740 CAD.Get free quotes for a project like this
I require a simple program that has a user friendly interface with simple boxes I can fill in with text or drop down boxes that allows me to alter the variables.
Scrapes Craigslist and Kijiji at a regular interval for the data below (time intervals must be controllable by me)
Search criteria (I want boxes I can fill with text for these)
-Multiple cities/regions of my choosing must be continually scraped at the interval of my choosing as listed above
-Multiple categories of my choosing must be searched at same time (example: 'used cars' AND 'for sale/buying' from kijiji at same time etc...)
-Multiple keywords at same time (example: 'iphone' AND 'or best offer' etc...)
-Multiple keywords must also be able to be OMMITTED from search results (example: I may want to search for the term 'negotiable' but omit results that say 'NOT + negotiable'. I also want to be able to omit items from kijiji that have 'WANTED:' next to them.)\
-Search results older than a set date of my choosing are also omitted (this isn't very important if it is difficult to do)
Search result layout
-Results MUST be possible to list in order category (example: cars, phones) and in order of preference WITHIN said category (example: within the category of 'PHONES' if 2 searches are performed at the same time 'iphone + 16gb' and 'iphone + 32gb' , I want to indicate which results I want placed higher in priority on my 'PHONES' results list. In this example, I may want the results from the 'iphone + 16gb' listed before I see 'iphone + 32gb')
-Results after sorting merely need to be displayed as they are on craigslists/kijiji website - simple titles - I will read the titles and click on them to read the description further if I so desire. Clicking on said titles will bring me to the description on their website, whereby I can contact the user.
-I want to be updated via alerts somehow through my phone. If a certain item that I am searching for that meets my search criteria comes up I want it to notify me somehow (especially if it is in my higher criteria area)
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online