The targets are 3 websites on the same platform with similar structure. The scripts will:
1. Crawl target websites, parse and collect specific info.
2. Output gathered data into a SQL database table (about 14 fields) on our server, and email the output as a CVS file in an email attachment.
3. Schedule a cron job to run the scripts at defined interval (likely once daily).
The scraper must not be fragile (must continue to work for next 6 month if no significant change to target website). Use standard functions and minimize the use of regex whenever possible.
Signing of NDA is required. If interested, please submit a bid. Once an NDA is signed, we will provide detailed info on target websites and fields to collect for you to analyze and provide quote and timeline.