Completed

Need updated web spider scraping program written for the username WERMPN

I need a web scraper written for the following url:

[login to view URL]

All information needed is available on the main page. The number of rows will vary.

Data is in separated rows under the column headers.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin Location" column, data will be located on the top row of each separated column, data is bold and the text is located before the comma and two letter abbreviation

origin_state --> data located in the "Origin Location" column, data will be located on the top row of each separated column, data is bold and the text is the two letter abbreviation after the comma

ship_date --> data located in the "Origin Location" column, data will be located below the origin_city and origin_state, changed to the YYYY-MM-DD format, the time does not need to be added

destination_city --> data located in the "Destination Location" column, data will be located on the top row of each separated column, data is bold and the text is located before the comma and two letter abbreviation

destination_state --> data located in the "Destination location" column, data will be located on the top row of each separated column, data is bold and the text is the two letter abbreviation after the comma

receive_date --> data located in the "Destination Location" column, data will be located below the destination_city and destination_state, changed to the YYYY-MM-DD format, the time does not need to be added

trailer_type --> data located in the "Equipment / Weight" column, data will be located on the second row of each separated column. IE: Van or Reefer

load_size --> add the text "Full"

weight --> data located in the "Equipment / Weight" column, data will be located on the third row of each separated column, the comma and lbs is not needed IE: 23,994 lbs would just be 23994

length --> Leave blank

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> leave blank

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> leave blank

comment --> data located in the "Reloads" column in each separated row

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contain no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: write web spider, web spider development, need end web designer, web spider source, web spider crawling website robot vbnet, need adult web designer right, web spider collect data, email scraping program, need magento web designer, build program written, game dont need flash web, need create web community, web spider free mysql, web spider source code, web scraping program, need program written, daily updated web scraping, need program written website, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, write a web scraping program to display top 250 movies rated in imdb com

About the Employer:
( 83 reviews ) Chillicothe, United States

Project ID: #29404316

Awarded to:

(574 Reviews)
7.9

9 freelancers are bidding on average $164 for this job

rkurilenko007

Hi! raccon I am a professional Perl Scraping expert who has a lot of experience in scraping including Amazon, [login to view URL], eBay, and so on. My own scraping way and libraries always lead me to success. Using Scrapy, Selen More

$300 USD in 7 days
(11 Reviews)
5.3
josanta

Hi, I am interested in this project plus I have materials and a lot of experience please chat so I can start immediately. Thank you!

$300 USD in 4 days
(6 Reviews)
3.1
Techiedev

Hi there I read your request.i can do all thing you want. I have worked in various fields of programming and web scraping with python and I can do your project using the beautifulSoup ,scrapy(spiders) ,requests and Sel More

$120 USD in 2 days
(2 Reviews)
2.7
zhy

raccoon Hello there, I can develop web scraper. Since the data we need to collect in hidden class so I plan to use Selenium IDE or imacros. Thank you//Fanzy

$75 USD in 2 days
(2 Reviews)
2.2
ruslikpetr

Hi I've read your requirements in details. I think there is no technical difficulty to get the required fields. And you suggested perl and I recommend to use python instead of that. Of course, that's excutable in lin More

$150 USD in 3 days
(4 Reviews)
2.2
spx2

Hi I can write this scraper for you in Perl, I'm experienced with it and have written many other ones before. Let me know if you're interested Best regards, Stefan

$200 USD in 7 days
(2 Reviews)
2.0
andreyvanishevf

Hello job I'm a Python software developer with 7+ years of experience. My expertise is covering full ETL pipeline, exactly web scraping, crawling and data processing, data loading to any databases. Strong background in More

$140 USD in 7 days
(0 Reviews)
0.0
teachingSPED

Hi there, I am expert Perl and C++ programmer. I have expertise of both Linux and Windows development in Perl, C and C++. I have the knowledge of object oriented programming and design patterns. I can implement differ More

$100 USD in 7 days
(0 Reviews)
0.0