Spider to crawl

This project was successfully completed by ricardofranco for $45 USD in a day.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
Completed In
1 day
Total Bids
Project Description

Create a python class with the following interface.

class AutoTraderSpider(object):

def __init__(self, start_url):

def __iter__(self):
return self

def next():
"""Returns next advert

Parameter "start_url" is a uri such as:
[url removed, login to view]

Fetching url will return zero or more adverts on one or more pages.

Iteration over the object returns the details of the individual adverts as a dict or object. Each result object provides the following information:

url: The url that refers to the advert
price: price of the vehicle
mileage: mileage of the vehicle
transmission: Manual, Automatic, etc.
fuel: Petrol, Diesel, etc.
advertType: Trader or Private

It might be necessary to follow the link to the the individual adverts to retrieve all this information. If so then it should be possible to control this behaviour by means of a boolean flag to the AutoTraderSpider constructor.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online