Completed

Spider to crawl autotrader.co.uk

This project was successfully completed by ricardofranco for $45 USD in a day.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
N/A
Completed In
1 day
Total Bids
8
Project Description

Create a python class with the following interface.

class AutoTraderSpider(object):

def __init__(self, start_url):
pass

def __iter__(self):
return self

def next():
"""Returns next advert
""""

Parameter "start_url" is a uri such as:
[url removed, login to view]

Fetching url will return zero or more adverts on one or more pages.

Iteration over the object returns the details of the individual adverts as a dict or object. Each result object provides the following information:

title:
url: The url that refers to the advert
price: price of the vehicle
mileage: mileage of the vehicle
transmission: Manual, Automatic, etc.
engine_size
fuel: Petrol, Diesel, etc.
advertType: Trader or Private
distance
year
registration
bodystyle

It might be necessary to follow the link to the the individual adverts to retrieve all this information. If so then it should be possible to control this behaviour by means of a boolean flag to the AutoTraderSpider constructor.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online