This scraper should be done in PERL or PHP and MySQL as database.
We want to contact the brokers of listings on a real estate marketplace. We suggest to use two scripts which would run as separate cron jobs:
Scrape listings based on search criteria and save some data (listing title, building address, broker name, e-mail. URL) in a DB table. The e-mail is only available by "clicking on a link" that is loaded with AJAX.
Generate an e-mail to the broker from a set of 5 standard e-mails we have and flag the listing in the DB table as "contacted". E-mail is sent through GMAIL.
Scraper will run as a job that maybe visits 2-3 listings every 5 minutes (not to trigger IP blockage). Marketplace might be secured through captchas- let's discuss how you could help here if that is the case.
The scraper should be built in a way that main functions can be re-used for scraping more marketplaces.
Provide references of past bot/scraping projects in PERL + result of 2+9=? in your bid (to make sure you're not a bot)