Completed

Spider to crawl autotrader.co.uk

This project was successfully completed by ricardofranco for $45 USD in a day.

Get free quotes for a project like this
Employer working
Project Budget
N/A
Completed In
1 day
Total Bids
8
Project Description

Create a python class with the following interface.

class AutoTraderSpider(object):

def __init__(self, start_url):

pass

def __iter__(self):

return self

def next():

"""Returns next advert

""""

Parameter "start_url" is a uri such as:

[url removed, login to view]

Fetching url will return zero or more adverts on one or more pages.

Iteration over the object returns the details of the individual adverts as a dict or object. Each result object provides the following information:

title:

url: The url that refers to the advert

price: price of the vehicle

mileage: mileage of the vehicle

transmission: Manual, Automatic, etc.

engine_size

fuel: Petrol, Diesel, etc.

advertType: Trader or Private

distance

year

registration

bodystyle

It might be necessary to follow the link to the the individual adverts to retrieve all this information. If so then it should be possible to control this behaviour by means of a boolean flag to the AutoTraderSpider constructor.

Completed by:
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online