Spider to crawl [url removed, login to view]

This project was successfully completed by ricardofranco for $45 USD in a day.

Get free quotes for a project like this
Project Budget
Completed In
1 day
Total Bids
Project Description

Create a python class with the following interface.

class AutoTraderSpider(object):

def __init__(self, start_url):


def __iter__(self):

return self

def next():

"""Returns next advert


Parameter "start_url" is a uri such as:

[url removed, login to view]

Fetching url will return zero or more adverts on one or more pages.

Iteration over the object returns the details of the individual adverts as a dict or object. Each result object provides the following information:


url: The url that refers to the advert

price: price of the vehicle

mileage: mileage of the vehicle

transmission: Manual, Automatic, etc.


fuel: Petrol, Diesel, etc.

advertType: Trader or Private





It might be necessary to follow the link to the the individual adverts to retrieve all this information. If so then it should be possible to control this behaviour by means of a boolean flag to the AutoTraderSpider constructor.

Completed by:
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online