I need a web scraper written for the following url:
[url removed, login to view]
All information needed is available on the main page. The number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data is located in the first column
origin_state --> data is the 2 letter abbreviation after the origin city in the first column
ship_date --> data is located in the fourth column, change to the YYYY-MM-DD format, if the
date is a past date change to the current day's date also in the YYYY-MM-DD format
destination_city --> data is located in the second column
destination_state --> data is the 2 letter abbreviation after the destination city in the second column
receive_date --> data is located in the fifth column, change to the YYYY-MM-DD format, if the date
is a past date change to the current day's date also in the YYYY-MM-DD format
trailer_type --> data is located in the sixth column
load_size --> add text "full"
weight --> leave blank
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> leave blank
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> add data located in the third and seventh columns
load_number --> leave blank
commodity --> leave blank
The first line of the output should contain all of the column headers.
Any field that contains no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called '[url removed, login to view]' and the output file should be
called '[url removed, login to view]'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
I'm talking about same Perl scraper (using WWW::Mechanize and HTML::TreeBuilder::LibXML) as before. It will output into pipe separated file just like you want.
6 freelancers are bidding on average $135 for this job
raccoon I can write such script on Python. It will take 30 minutes approx. I will deliver you .py file that you can run by cron and it will supply you with pipe delimited file.