Completed

Need new web spider scraping program written for the following username JLM8203

I need a web scraper written for the .xlsx file in the following directory:

[login to view URL]

The latest .xlsx file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .xlsx extension.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in column "A"

origin_state --> data located in column "B"

ship_date --> the date from column "E" changed to the YYYY-MM-DD format

destination_city --> data located in column "C"

destination_state --> data located in column "D"

receive_date --> leave blank

trailer_type --> the abbreviation located in column "F"

load_size --> add text "FULL"

weight --> data located in column "K"

length --> data located in column "J"

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> leave blank

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> leave blank

comment --> leave blank

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contain no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Linux, Perl, Web Scraping

See more: scrapy, web scraping, python scrapy example, web crawler open source, octoparse, web crawler python, scrapy python 3, web crawler tool, write web spider, web spider development, need end web designer, web spider source, web spider crawling website robot vbnet, need adult web designer right, web spider collect data, email scraping program, need magento web designer, build program written, game dont need flash web, need create web community

About the Employer:
( 62 reviews ) Chillicothe, United States

Project ID: #17800058

Awarded to:

gangabass

I can provide you same Perl scraping program for [login to view URL] as before: using WWW::Mechanize, Text::CSV_XS.

$88 USD in 1 day
(410 Reviews)
7.2

7 freelancers are bidding on average $156 for this job

yongjin818

raccoon, Dear I am an expert in web scraping. In before, I developed 400+ spiders using scrapy, php, selenium. For example, I scraped data for Many products informations from these sites(ex: ebay, amazon, welivv, booki More

$111 USD in 3 days
(46 Reviews)
5.6
SidhuDN

Hello Sir I read your job carefully and see the attached file. I can do this job professionally. I can follow instructions really well. I have a lot of experience in Data Entry, Web Scraping, Internet Research. If More

$150 USD in 3 days
(6 Reviews)
4.1
olasheni

I am an excellent web and software developer with over 7+ years experience. I want to use this skills to provide you good works. Please provide more information on your project and get it done. Thanks.

$222 USD in 3 days
(1 Review)
2.4
devfrenzy007

Dear sir. I have reviewed your job posting very carefully and I'm an exact match for it. You can see my previous works and expertises. Allow me to introduce myself. I am a Senior Linux Developer, having 7+ More

$222 USD in 3 days
(2 Reviews)
2.4
yasasgun

raccoon Hello. I am happy to work on this project. Please provide me additional information if you need to continue. Regards

$100 USD in 1 day
(0 Reviews)
0.0
MRE000

Hi, I've BS degree in Computer Science, i have 6Y+ of experience in Web Development, Software Engineering, Quality, Linux. i am currently offering high quality work for very cheap prices, because i am a new member a More

$200 USD in 7 days
(0 Reviews)
0.0