Web scraper in Python with Scrapy ( for vBulletin forums

This project was successfully completed by M5L2764K for $60 USD in 2 days.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
$30 - $250 USD
Completed In
2 days
Total Bids
Project Description

I need a web scraper, developed in Python with Scrapy ([url removed, login to view]) for vBulletin forums.

In the pipeline (see Scrapy's concept of pipelines) I need to receive each message posted in a specific vBulletin forum, with the following fields:

- Member name

- Post html content

- Post date/time

- Post #id

- Post permalink

- Thread name

- Thread #id (the #id may be at the beginning of the thread url or at the end, this should be configurable)

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online