We are a team of engeneers, specialized in SEO consulting.
We want you to code us **a script that will crawl specific pages**, among a selection of sites, and that will then **report us needed informations**.
## Deliverables
***** The script will have 3 main tasks :
** 1. Check the presence of backlinks on specific pages ==> *we give the url that needs to be checked on a specific page, then the script tells us if the backlink is still on that page.*
2. Positionning reports on specific pages ==> *we give the url which position needs to be checked on specific toplists, then the script tells us the site’s rank on that page.*
3. Ping servers ==> *in order to check if specific servers are still available, and alert us if there is any downtime
*
***** Precision about the project :
** * the script will pass through proxys. We will provide the list of proxys that need to be used.
* Pages to crawl and others "missions" data are already in DB tables. No interface is needed.
* Script will be launched by crontab and will perform checks daily
* Reports are put into a DB table, alerts are sent by mail
***** Platform :
** Programming language: PHP (also accepted : Python / Perl )
Database : MySQL
Server OS: Linux