Looking for PHP Cron Job scraping solution which can:
- Log into a site
- Scrape Tables (each table is different, but use simple HTML)
-Tables update Monday - Friday around 11:30 EDT and solution should know if the data is
new or not using date comparison logic). Example:
Friday, November 2, 2018 > Thursday, November 1, 2018 if TRUE then [SCRAPE] ELSE
DELAY 60 MIN REPEAT
- Store data to MySQL tables (1 MySQL table per data table)
- Log out of the site (very important because if the session is not logged out then we cannot log in from another browser)
-Config file to set login credentials, MySql connection properties, Frequency, table links, etc
- MySql create table SQL files for each table
- If a PHP package is needed for data scraping and/or login/out then it should be free and easy to install on Apache.
Sample scrape html files can be found here: [login to view URL]
Login page: [login to view URL]
20 freelancers are bidding on average $148 for this job
Hello. I have good skills in Data Mining, MySQL, PHP, Software Architecture, Web Scraping. I have checked your project carefully and i can do it. Contact me please. Thank you.