Web scraper in Python with Scrapy (scrapy.org) for vBulletin forums

  • Status Completed
  • Budget $30 - $250 USD
  • Total Bids 11

Project Description

I need a web scraper, developed in Python with Scrapy ([url removed, login to view]) for vBulletin forums.

In the pipeline (see Scrapy's concept of pipelines) I need to receive each message posted in a specific vBulletin forum, with the following fields:

- Member name

- Post html content

- Post date/time

- Post #id

- Post permalink

- Thread name

- Thread #id (the #id may be at the beginning of the thread url or at the end, this should be configurable)

Get free quotes for a project like this
Completed by:
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online