In Progress

Spider to crawl [url removed, login to view]

Create a python class with the following interface.

class AutoTraderSpider(object):

def __init__(self, start_url):


def __iter__(self):

return self

def next():

"""Returns next advert


Parameter "start_url" is a uri such as:

[url removed, login to view]

Fetching url will return zero or more adverts on one or more pages.

Iteration over the object returns the details of the individual adverts as a dict or object. Each result object provides the following information:


url: The url that refers to the advert

price: price of the vehicle

mileage: mileage of the vehicle

transmission: Manual, Automatic, etc.


fuel: Petrol, Diesel, etc.

advertType: Trader or Private





It might be necessary to follow the link to the the individual adverts to retrieve all this information. If so then it should be possible to control this behaviour by means of a boolean flag to the AutoTraderSpider constructor.

Skills: Python, Web Scraping

See more: autotrader python, crawl autotrader, web scraping uk, scraping python link, scraping python, python scraping, fuel diesel, Diesel , autotrader, automatic scraping, manual scraping, url crawl, search spider, link spider, search python, python url, python web fetching, url spider, python interface, cars year, python class, spider python, manual web scraping, python search, price spider

About the Employer:
( 0 reviews ) Horsham, United Kingdom

Project ID: #4017974

Awarded to:


Hi, I'm a experienced Python developer. I sent you more info via PMB. Check it, please.

$45 USD in 1 day
(1 Review)

8 freelancers are bidding on average $99 for this job


Hi, Please check your inbox for details.

$55 USD in 1 day
(10 Reviews)

I can easily do this project. I have vast experience in web scraping, and expertise with many web scraping modules including mechanize, urllib2, urllib, re, BeautifulSoup, and more.

$50 USD in 1 day
(6 Reviews)

Hello, I'm experienced python developer. My specialization is data mining and scraping. I will be happy to help you and you will be fully satisfied. Thank you.

$100 USD in 4 days
(3 Reviews)

I made hundreds of parsers like this, but for real estate in LA. The tools to do it are mechanize and BeautifulSoup, the rest is merely python and its standard library.

$100 USD in 1 day
(2 Reviews)

I am a scraping specialist. I scraped many websites and can export the data in any format.

$150 USD in 3 days
(0 Reviews)

We are freelance software developers. If you contact me I can give a quote for your project and we can discuss the details. <b><i>Removed by Admin</i></b>

$140 USD in 1 day
(0 Reviews)

I am a Pro in Python,HTML5,jquery. I can code the best in python. I already did slightly like this [url removed, login to view] Please check the website.

$150 USD in 3 days
(0 Reviews)