Completed

Web scraper in Python with Scrapy (scrapy.org) for vBulletin forums

This project was successfully completed by M5L2764K for $60 USD in 2 days.

Get free quotes for a project like this
Employer working
Completed by:
Skills Required
Project Budget
$30 - $250 USD
Completed In
2 days
Total Bids
11
Project Description

I need a web scraper, developed in Python with Scrapy ([url removed, login to view]) for vBulletin forums.
In the pipeline (see Scrapy's concept of pipelines) I need to receive each message posted in a specific vBulletin forum, with the following fields:
- Member name
- Post html content
- Post date/time
- Post #id
- Post permalink
- Thread name
- Thread #id (the #id may be at the beginning of the thread url or at the end, this should be configurable)

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online