Need some work done? Post a Project Today
I need a PHP/MySQL scraper (fast) to scrape ads + other information from Plenty Of Fish dating site. Features for the scraper:
1. Allow multiple PoF accounts to be stored and used (username + password + account details such as ethnicity, age etc). and new accounts should be easy to add at a later date.
2. Run automatically at a certain interval (e.g. once a day, twice a day)
3. Ability to specifiy how many ads to scrape per session
4. Proxy support - I will provide proxies but everything must be done through proxies to avoid accounts being banned.
5. Scrape image, ad headline and ad text and record in database along with the account that the ad was seen on.
6. Also scrape the target URL (but without following the link)
7. If an account is banned (details will be provided on how to detect a ban), it should be flagged in the database and not used for the next run
8. I would also like an account creator for POF that works 100%
9. I would like to know if there is a way to store the actual banners, images and landing pages to a database