Completed

Need a web spider scraping program written for the following username FTL6528

I need a web scraper written for the following url:

[login to view URL]

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data is located in the "From" column before the comma

origin_state --> data is located in the "From" column after the comma

ship_date --> data is located in the "Date" column, change to the YYYY-MM-DD format

destination_city --> data is located in the "To" column before the comma

destination_state --> data is located in the "To" column after the comma

receive_date --> leave blank

trailer_type --> data is located in the "Equip." column

load_size --> data is located in the "Type" column

weight --> leave blank

length --> leave blank

width --> leave blank

height --> leave blank

trip_miles --> data is located in the "Miles" column

pay_rate --> leave blank

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> leave blank

comment --> add data located in the "BOL" column with text "Lading=" before the data; if the "Equip" column has "BW" as the data, add the text "Blanket Wrapped" to comment

load_number --> data is located in the "Ref No" column

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specify what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, need web scraper takes search data excel, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder

About the Employer:
( 68 reviews ) Chillicothe, United States

Project ID: #22820650

Awarded to:

gangabass

I know about "raccoon". I'm talking about same Perl script as before: WWW::Mechanize, Text::CSV_XS etc. Thanks. Roman

$88 USD in 1 day
(493 Reviews)
7.5

7 freelancers are bidding on average $134 for this job

mantislin

Hi there, I am scraping expert. I have did more than 350+ scraping projects. Can we discuss more details about your project? then i can do example data or script for you, we can continue after you checked example dat More

$140 USD in 3 days
(297 Reviews)
7.6
songhku925

raccoon Hi I have already finished lots of Web Crawling, Scraping and Automation project using python Scrapy, Bs4, Selenium. I can extract data you want from any site and I can store extracted data to database or singl More

$150 USD in 3 days
(4 Reviews)
4.7
xuwentao821

Hi, Glad to apply to your offer. I have gone through your job description in depth, and now I am sure that I can develop what you want exactly to your expectations. I have been through many frameworks that boosts effe More

$140 USD in 7 days
(16 Reviews)
3.8
bojanalmei

⭐⭐⭐ raccoon ⭐⭐⭐ I have read your description in detail and got a convinced I can complete this work with my heavy experiences in Need a web spider scraping program written for the following username FTL6528 My GitHub More

$140 USD in 1 day
(0 Reviews)
0.0
Alenaweb

Web site Development Expert here. [login to view URL] [login to view URL] These are the most successful works in my history. I am a full time freelancer who have than 9 years of experience More

$140 USD in 7 days
(0 Reviews)
0.0
tasbasi01

raccoon i've 6 yrs experince in IT (as System Administrator), i used and managed Microsoft System Center Family products like SCCM and MS SQL Servers and databases as a specialist, familiar with MS Exchange, MS SCCM More

$140 USD in 2 days
(0 Reviews)
0.0