Completed

Need updated web spider scraping program written for the username GREENBUSH

I need a web scraper written for the following url:

[login to view URL]

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "PickupCity” column

origin_state --> abbreviation located in the "PickupState" column

ship_date --> will have to click on the blue + under the "Expand All" column to retrieve data from "Pickup Date" column, changed to the YYYY-MM-DD format

destination_city --> data located in the "DestinationCity" column

destination_state --> abbreviation located in the "DestinationState" column

receive_date --> leave blank

trailer_type --> put the text "F"

load_size --> put the text "Full"

weight --> leave blank

length --> leave blank

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> leave blank

contact_phone --> add text "334-585-7075"

contact_name --> leave blank

tarp_required --> leave blank

comment --> data located in the "Loads" column, add the text "Loads=" before data

load_number --> will have to click on the blue + under the "Expand All" column to retrieve data from "Load ID" column

commodity --> will have to click on the blue + under the "Expand All" column to retrieve data from "Commodity" column

If there are multiple rows available when you expand a row then each of those additional rows needs to be added using the same "PickupCity", "PickupState", "DestinationCity" and "DestinationState" that was listed.

The first line of the output should contain all of the column headers.

Any field that contain no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: write web spider, web spider development, need end web designer, web spider source, web spider crawling website robot vbnet, need adult web designer right, web spider collect data, email scraping program, need magento web designer, build program written, game dont need flash web, need create web community, web spider free mysql, web spider source code, web scraping program, need program written, daily updated web scraping, need program written website, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, write a web scraping program to display top 250 movies rated in imdb com

About the Employer:
( 83 reviews ) Chillicothe, United States

Project ID: #29403708

Awarded to:

(569 Reviews)
7.9

11 freelancers are bidding on average $150 for this job

(338 Reviews)
7.1
schoudhary1553

Hi, Greetings! ✅ I have checked and gone through the project details and I am very skilled in it. ✅Completed Time: In project deadline We have worked on 640 + Projects. I have 6 + years of the experience in sam More

$220 USD in 4 days
(34 Reviews)
6.5
metlickijv

Hi Jon. I am a top talent python scraping expert with extensive experience. I have complete many similar projects using frameworks and libraries such as scrapy, selenium, requests, beautifulsoup, lxml and etc, As an ex More

$140 USD in 1 day
(10 Reviews)
5.9
(39 Reviews)
5.1
belalihabibullah

Dear sir, I read your requirement. I have good experience in Web Scraping using PHP, Python, JavaScript, - information from output excel, CSV. I would like to work on this project and can complete with 100%accurac More

$45 USD in 1 day
(21 Reviews)
4.9
novepi

Hi, raccoon The requirements are quite clear. If there're multiple rows upon expanding each one will be saved as a new record in the output file. Obviously, they'll have the same data for the columns belonging to pare More

$100 USD in 1 day
(8 Reviews)
4.7
programming2482

Hi, Good Day, I am experienced developer. I have expertise in C, C++, Perl, CGI, bash script, Java. I have written many Perl scripts including API integration (XML). I am a LAMP developer (Linux, Apache, MySQL, Perl). More

$100 USD in 12 days
(1 Review)
1.0
DimaHood

"raccoon" Hi. I have read your detail carefully and can help you ([login to view URL]). scraping: python -> database-> getting data on per script from database(or csv, txt)->. pipSV My works - python scraping http More

$140 USD in 7 days
(0 Reviews)
0.0
teachingSPED

Hi there, I am expert Perl and C++ programmer. I have expertise of both Linux and Windows development in Perl, C and C++. I have the knowledge of object oriented programming and design patterns. I can implement differ More

$120 USD in 10 days
(0 Reviews)
0.0
marysindri2020

Hello. I see you need to scrape for the url [login to view URL] I have rich experience in srcaping using selenium, beautifulsoup, scrapy in python, c#, node.js. Also good at Perl, Linux like CentOS, Ubuntu, Fedo More

$250 USD in 3 days
(0 Reviews)
0.0