Completed

Need a web spider scraping program written for the following username ONEWAYT

I need a web scraper written for the following URL:

[login to view URL]

The URL will open a .csv file with the information needed.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin City" column

origin_state --> data located in the "Origin State" column

ship_date --> data located in the "Available Date" column, change to the YYYY-MM-DD format

destination_city --> data located in the "Destination City" column

destination_state --> data located in the "Destination State" column

receive_date --> leave blank

trailer_type --> add the text "Power Only" for all rows

load_size --> add the text "Full" to this column

weight --> leave blank

length --> leave blank

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> data located in the "Revenue" column

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> leave blank

comment --> data located in the "Quantity" column, add text "Quantity=" before the data; also include data from the "Type" and "Extra Info" columns

load_number --> leave blank

commodity --> data located in the "Equipment" column

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, why do we need web scraping

About the Employer:
( 68 reviews ) Chillicothe, United States

Project ID: #22668469

Awarded to:

gangabass

Thank you for your invitation! I can provide you a Perl scraping script that will use same modules as before.

$88 USD in 1 day
(491 Reviews)
7.5

21 freelancers are bidding on average $126 for this job

mantislin

Hi there, This is Lin, Can we discuss more details about your project? then i can do example data or script for you, we can continue after you checked example data. I did more than 380+ scraping project, please view More

$114 USD in 3 days
(294 Reviews)
7.6
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the More

$175 USD in 3 days
(105 Reviews)
7.3
adampohp79

Hi. thanks for your posting. I'm very happy to have a chance of bidding your project. I have experience in development of the projects like yours If you hire me, I'll do my best for your project and finish greatly in a More

$140 USD in 7 days
(22 Reviews)
5.3
songhku925

"raccoon" Hi. I have already finished lots of Web Crawling, Scraping and Automation project using python Scrapy, Bs4, Selenium. I can extract data you want from any site and I can store extracted data to database or si More

$100 USD in 3 days
(3 Reviews)
4.6
yashashahj1397

Hi, I saw your post regarding web scraping. I have done many projects based on Automation and scraping I am an IT Engineer and certified UIPATH [login to view URL] primary skills are Python(Selenium, Beutifulsoup, scrappy, pa More

$140 USD in 7 days
(9 Reviews)
4.1
topexpert713

Hi, Nice to meet you! I have read your requirements carefully and I am very interested in your project. I am confident of this project as I'm a professional Python,Scraping expert with over 5 years of experience. It s More

$140 USD in 7 days
(8 Reviews)
4.3
ranganathp

FREELANCER RECOMMENDED ------------------------------------------------------ Can help... I am a Fullstack Expert in development of web, desktop and mobile apps... Lets Start! Please start a Discussion with me and we c More

$140 USD in 7 days
(9 Reviews)
4.2
michaels225

It's a piece of cake for me. Hi, sir I am a Web scraping expert. I have many experiences like your project. I am very confident to complete this task in a few days. I am ready for your project and I will provide the b More

$50 USD in 3 days
(4 Reviews)
3.5
AppDevelopHero

Hi. Credit is my motto. I am a freelancer working in 24/7 service. I have much experience for 12+ years in Scraping Field. I can do your job with php ,crawler,scrapy, BS4, Selenium modules of python. I have no any risk More

$30 USD in 1 day
(2 Reviews)
2.9
hassanalvi95

Hi sir, I am expert in scrapping data and made scrappers for Amazon, eBay, Adidas, and Nike. I made successful scrappers which are running 24/7 and downloading data for my clients. I need some more information from yo More

$200 USD in 7 days
(3 Reviews)
4.1
chunzuo

"raccoon" Hi, there! Nice to meet you I've extensive experience with web scrapping with Node.js and Python. I've checked your URL and it seems 1 or 2days work for me I'll use Node.js for your task Let's discuss more d More

$200 USD in 2 days
(2 Reviews)
2.0
ThinkAndCo

Hi, We are a team of professional software developers. We have expertise in Python and Web Scraping. We can readily work on your requirements. Kindly consider our proposal for best results. Looking forward to talking More

$100 USD in 3 days
(3 Reviews)
2.0
AiAge888

Hi! there. ⭐Thanks⭐ good post. I am web scraping expert. I am ready in any language such as PHP, Python, node.js. I have rich experience in scraping many sites. I want to meet you on the chatting. Regards.

$140 USD in 7 days
(2 Reviews)
1.7
akiramatsui0305

"raccoon" hi Client. i have read and understood your request.i am interested in your project and can do it very well. I have wide experience in Python scrapy development and i am looking forward to contact me, please. More

$70 USD in 1 day
(2 Reviews)
1.3
lvana19880908

Dear, sir. I have read your project proposal carefully and I am very interested in your work so bid. I am a Linux and web developer, and I have enough experience to web-scrap with selenium, bs, request in Python, c#. I More

$140 USD in 7 days
(1 Review)
1.4
covetusshare

Hello... I saw your job posting, I help you with your project, please connect me so that we can more discuss regarding for your project. Awaiting for your reply! Regards,

$140 USD in 7 days
(0 Reviews)
0.0
matiasjumadiaz

raccoon Hi - Scrape Debates into CSV, Excel [login to view URL] - Scraping and automation [login to view URL] More

$150 USD in 3 days
(0 Reviews)
0.0
Alenaweb

I have read your project description, and I noticed that these types of projects are very familiar to me. I am ready for all the required skills and I can jump into this project just from now. As a Software Engineering More

$140 USD in 7 days
(0 Reviews)
0.0
adam01025

Hello. I am the data entry/processing/mining/scraping and automation expert and I've solid experience in similar works. I am a experienced programmer, so I use various automation tools that I specially made. I am ready More

$140 USD in 7 days
(0 Reviews)
0.0
Geracimov

Hello, sir. How are you? I have just read your project description and I can help you with my experiences. Don't waste your golden time to looking for a developer! I'm new freelancer, but I will make the perfect produc More

$100 USD in 3 days
(0 Reviews)
0.0