This is a web scraping project where you will need to write a script that will navigate through a series of 3-4 pages (on each page you will need to fill in data for 5-6 fields), in order to arrive upon a final page where you will get the number that you will need to scrape. This number on the last page must be recorded in to a database on my server (I alreday have MysQL configured).
The data for the input fields mentioned above can be given to you in a spreadsheet or csv format.
You will have to set up a cron or some other means so that the script can run at a preset time interval (ie once every minute).
If you are successful at this project, then I will consider hiring you to do the same thing for 5 other (very similar websites).
*The script must run on my linux server that does not have a GUI.
*The script MUST be written in PERL
*The script must go through TOR (which is already configured for other applications on my server), otherwise, my IP could be banned.
*I want you to start this project immediately ad finish within 1-2 days.
If you are interested, please make a bid and post ONE SENTENCE saying why I should choose you for this project.
14 freelancers are bidding on average $143 for this job
I once crashed a web forum via a stack overflow in its tree layout rendering script (from Linux with Perl), I can send you source with a few bolts removed.
Hi, I'm full time scipting guy with more than 10 years of experience in Linux/Perl/MySQL/PHP. Doing Perl/Shell scripting is my daily job. Throw me a line and i talk about timing and price in littler more.