Closed

Banner Ad Scraper

This project received 13 bids from talented freelancers with an average bid price of $1138 USD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
N/A
Total Bids
13
Project Description

I need a PHP/MySQL scraper (fast) to scrape ads + other information from Plenty Of Fish dating site. Features for the scraper:

1. Allow multiple PoF accounts to be stored and used (username + password + account details such as ethnicity, age etc). and new accounts should be easy to add at a later date.
2. Run automatically at a certain interval (e.g. once a day, twice a day)
3. Ability to specifiy how many ads to scrape per session and what pages links to visit to scrape the ads from.
4. Proxy support - I will provide proxies but everything must be done through proxies to avoid accounts being banned.
5. Scrape image, ad headline and ad text and record in database along with the account that the ad was seen on.
6. Ability to keep track of images/text combination and times it has appeared through scrape sessions.
6. Also scrape the landing page URL, ad's tracker link(s) and offer URL page.
7. If an account is banned (details will be provided on how to detect a ban), it should be flagged in the database and not used for the next run
8. I would also like an account creator for POF that works 100%
9. Ability to store data and analyze the same.
A detailed sample will be provided to clarify any questions.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online