Need a script to scrape craiglist ads with my keywords in every city


I'm looking for software that will scrape a craiglist category of my choice, looking for my specific keywords. THe search would work exactly how their search on their site works, to find related posts. For example, I pick "sporting" category. I would then enter keywords, such as, "basketball" "baseball" "soccerball".

It would have up to 10 separate lines for search So for the example I used, it would find all posts for basketball, then find all posts that contain baseball, then all that contain soccerball. And in the end it will make a long list of all the posts it finds. I need it to remove duplicates. And I need it to be able to be date specific. So if I want June 1 - June 15, I can do that. And on the output file, it will show the dates I chose. I would also like to be able to save this file, so I can open it up when I need. I would like to be able to mark it as "replied" if and when I reply to the ad. I also want to have a box for "does not contain" beside the search box. So if I'm searching for "soccerball", and for "Does not contain" I put "red", it will filter out any posts that are selling a red soccerball.

When you do a search it usually also lists "here is what we found nearby", which lists results from cities that are close. Since we are doing each city, it would probably be best if we could remove that from scraping, as we'll end up with dozens of duplicate posts, that will eventually have to be filtered out anyways. If there's no easy way to do that, than whatever. I just wanted to give a heads up that the search results do that.

I also think it might be a good idea to set timers for the search, as I'm sure they don't what 1000s of search queries in minute. Either that or I'll need an option to use proxy servers for search.

So for the output, I want to have a long list, with the post titles separated in groups by their search term, ie "baseball" "soccerball", etc.

Then when I click the ad, it will bring me to the online ad. It will also have the date beside it.

This project may be a Windows desktop application, or an online script, whichever is easier and cheaper. This is for personal use, so I don't care too much how the program actually looks.

Let me know if you have any questions.

Skills: Microsoft, PHP, Visual Basic, Web Scraping, Windows Desktop

See more: what program do i use to open a php file, want to post a ad, want to do ads, site scraping online, searching program in c, post online ads, open visual basic file online, online post ads, online filter proxy site, make ads online, how to find work online, 1 minute ads, scrape ads, Pick basic, minute script, craiglist ad, visual basic baseball project, project online software selling, need option script, basketball program, need ads craiglist, heads list, baseball project visual basic, filter post category, questions basketball

About the Employer:
( 133 reviews ) wpg, Canada

Project ID: #4662441

13 freelancers are bidding on average $257 for this job


Hi! Our PHP Experts can do this project for you professionally. Please check PMB for details.

$309 USD in 5 days
(155 Reviews)

Hi, We will provide you with a .Net application. Regards Suvigya

$250 USD in 7 days
(71 Reviews)

I have lots of experience in scraping using java. Have scraped sites like yellow pages, amazon etc. Have completed project where scraped multiple sites for betting like bet-at-home, bet-online etc to parse the odds. Ha More

$277 USD in 3 days
(34 Reviews)

I specialize in web scraping. I can meet you requirements on this project. Be wary of low bids from inexperienced programmers, I have scraped craigslist before and I can complete this job properly.

$257 USD in 5 days
(21 Reviews)

Hello, I can do this work for you and I'm ready to start. Please see pmb for more details. Regards Raul

$166 USD in 7 days
(13 Reviews)

We have wide experience in web scrapping, we specialize in data-mining software. VB 6, VB.Net desktop applications. Yellow pages, forums, classified sites, directories and others are some of the areas we've developed c More

$95 USD in 1 day
(20 Reviews)

see private message

$444 USD in 19 days
(2 Reviews)

Dear anon989, I can quickly and cost effectively develop a Windows client based automated system to quickly and accurately scrape craiglist ads with your specified keywords in every city for you. An automated sol More

$277 USD in 30 days
(5 Reviews)

I have scraped many sites. Most recently DRE licenses in California (1.2M records) and a Museum Project (900 MB of images). I have scraped CL in the past and still have some of my old libraries that I used to do so. I More

$400 USD in 3 days
(3 Reviews)

Hi sir, I am ready to start I will provide you a PHP application which can be use as a website or as a desktop application . Please let me know on which site you want to search. Thanks Proweb solutionz

$120 USD in 4 days
(9 Reviews)

Hi, I have Scrapped More than 20 [url removed, login to view] Check PMB for more details.

$277 USD in 3 days
(0 Reviews)

Hello, I can build this scraper. Please check PM for more details. Nitin

$244 USD in 3 days
(0 Reviews)

Hi there, I recently wrote software which scrapes information from OLX, so getting it to work with Craigslist is no problem. My software inserts the scraped data into an online database, and I can export this to excel More

$222 USD in 3 days
(0 Reviews)