Custom Bot to Extract Data

Closed

I need someone that can make a custom bot. I use Windows and can run Perl, .Net, etc. I do not want it to be web based as that has proved to be slower but if you insist, I'll give it a try.

Here's how it could work.

In order to extract the data, you first have to have an active session with the website. That means I need a window (or a portion of one that I can visibility see) that stays open that I log-in. (I'll keep this window open and occasionally click around to keep the session active.)

I need the ability to load a list of URL's to extract data. I am OK with either the text being extracted or the code. Which ever is faster. It needs to be saved in CSV format. The HTML code is at the bottom and runs from line 156-228 on the page. Each page is the same.

Notice in the code that each field has a field name (ie: Name, Address, etc). I want to keep these in place so that it will look like "Name: Chris Jones". That way, when I sort it it will help better organize the data in case things get shifted around.

Each field name will needs its own column in CSV. Name, Address, City, State, Zip, etc.

This will need to support multiple threads since it needs to be fast.

I do not need to download any images or other files. I just need the text from each page.

Each URL is in this format: [url removed, login to view]

PS - Due to the nature of the data, I cannot provide a link for you to test. I realize this impacts the job but I cannot give out the data.

SAMPLE CODE ATTACHED -- (Runs from line 156-228)

Skills: Perl, PHP

See more: custom bot, how to get a better job, organize html code, make a custom, line bot, extract data, php open url extract, extract data saved html files, windows 2012 perl, perl code sample, website text extract, extract data text, html data load, perl csv html, extract text perl

Project ID: #4021284

22 freelancers are bidding on average $88 for this job

rsdsoftsl

I specialize in data scrapping/parsing. Please check PM for my suggestion.

$65 USD in 1 day
(195 Reviews)
7.0
VileGnosis

I have sent a private message to your inbox that contains my relevent skills and any questions I have.

$100 USD in 0 days
(156 Reviews)
6.6
mantislin

Hi sir, please check PM, thx Kimi.

$65 USD in 2 days
(119 Reviews)
6.4
marchent

I am interested to write a Perl script for this project.

$135 USD in 7 days
(162 Reviews)
6.3
tzo

Can do this in perl.

$65 USD in 1 day
(204 Reviews)
6.2
gangabass

I can provide you excellent Perl solution in less than a day for just $50. See PMB for details.

$50 USD in 1 day
(189 Reviews)
6.2
vctheguru

Thanks for the sample file and it helped to analyze the problem. I am interested in the project.

$200 USD in 5 days
(28 Reviews)
5.6
zeroid

Im using C#, so that is not a problem. You do understand that the speed of this bot relies on the internet bandwidth. Anyway, here is my offer. 1. Full source code provided. 2. (more in PMB)....

$250 USD in 30 days
(26 Reviews)
4.8
FabioFelgueiras

Hi, we can get this done with multithreads fast and efficient i have done similar jobs can complete this jobs in 1 day if you wish we can talk in skype as i code it fabiofelgueiras82 please choose me :)

$70 USD in 1 day
(4 Reviews)
4.2
techvolcano

we can do this.

$35 USD in 4 days
(14 Reviews)
3.9
renanreis

I can extract the data you need

$50 USD in 3 days
(15 Reviews)
3.4
rohitagarberg

Sir we make professional web scrapers and we have 100% completion rate in all our projects. Please send us the link and the sample output.. Thanks

$30 USD in 2 days
(7 Reviews)
3.2
ilirjant

Done!Script attached!

$35 USD in 0 days
(1 Review)
1.0
V5KB8hmQ2

We are freelance software developers. If you contact me I can give a quote for your project and we can discuss the details. www.removed by admin

$140 USD in 1 day
(0 Reviews)
0.0
venky2venky

We done this type of project already. so we can do this one very easily.

$30 USD in 3 days
(0 Reviews)
0.0
Sukha

I've experiences on these things. And will do the work perfectly for you using Perl script. Multi-threaded and run continuously as you need by configuration.

$68 USD in 2 days
(0 Reviews)
0.0
CKJIT

get free demo and then get sure

$50 USD in 0 days
(0 Reviews)
0.0
mpljevaljcic

I can make this bot for you in one day.And it supports multithreading and everything else you need.Check PM.Regards

$30 USD in 1 day
(0 Reviews)
0.0
UltimatePsSource

Hello prospective client. We are a two-person team experienced in data extraction, especially HTML. Having completed several projects of this site, including just recently, we are confident we can implement a solution More

$80 USD in 0 days
(0 Reviews)
0.0
thomasqer

we will provide you complete Solution as per your need. For more detail please check our message where you can find our previous work too

$150 USD in 2 days
(0 Reviews)
0.0