In Progress

Extract Data From Website : Web Crawler

I need someone that can write a program, script, crawler, ect of some sort that can crawl through an existing

website and extract a large amount of data from that site. The data that I need to

collect is very organized on the website and should not be that hard to [url removed, login to view] finished product should

produce at least 700 excel files organized in folders on a server that I will specify later. Also, once the

master list is organized, I will need to update the data inside the excel files when the information on the

website changes. I also will be adding new excel files when needed if it does not exist when scanning for

updates. Here is how it needs to go be: Of course this can change if you think you know a more efficient way

of doing it.

1. Go to url: [url removed, login to view]

2. Login (we will provide)

3. Choose State in middle

4. Choose School in middle

5. Choose Courses on Right

6. (record list of departments that school offers...these will be in alphabetical order: example below)

ACCT Accounting

ADED Adult Education

AERO Aerospace Engineering

AFRI Africana Studies

AGEC Agric Economics

FORY Forestry

FOUN Foundations Of Educ

FOWS Forestry & Wildlife Sci.

Gdes Graphic Design

7. Choose First department in middle

8. (record the list of classes for each department: example below)

2110 Principles Of Financial Accounting

2117 Honors Principles Of Financial Accounting

2210 Principles Of Managerial Accounting

2810 Fundamentals Of Accounting

9. Repeat the process until all schools have been crawled and all departments and each department's classes.

As I said before, this is what needs to happen. I really don't care how it is programmed. The final product

should produce Excel files, or update them. If for some reason when updating an excel file you find that it

is no longer listed in the master list, it should just use the previous excel file and not delete the existing

one. There should also be a text file created that summaries what was completed, if an excel file was updated, or

a new one added. We need to know when a new excel file is added, updated, or deleted. This is very important

and is needed considering that this list will have at least 700 separate files.

A final Example Excel file will be provided as an example. We need this to be done by some type of program.

Doing this by hand normally takes about 3-4 hours per Excel file. Besides being unproductive, it is very boring.

We would like to get this done in one week. Please let us know if you have any questions. If you are really interested please

use the code IIcucucoolio in the message you send us. All other messages will be ignored. We don't want auto generated

messages. We will give a username and password that will be needed to enter site. Will send the website address in a private

message.

Skills: Excel, Web Scraping

See more: web crawler excel, web crawler data excel, site data crawler extract excel, extract data website password, write web crawler excel, excel web crawler, crawl website extract data, excel extract web data, program web crawler extract information website, crawler extract website, extract data website, iicucucoolio, www fory, write and design all think for website, what really needed when i want to be a design, what program to use for web design, what is web design course, what is the engineering design process, what is a web script, what financial accounting, what are the principles of design, website of accounting, website design classes, web scraping process, web engineering

About the Employer:
( 4 reviews ) Acworth, United States

Project ID: #545228

Awarded to:

xamdam91

Looking forward to working with you...

$60 USD in 0 days
(17 Reviews)
4.4

19 freelancers are bidding on average $142 for this job

SigmaVisual

We can help in your project, please check PMB to see our related experience.

$200 USD in 3 days
(29 Reviews)
6.2
MAnkita

Hello,Please refer your [url removed, login to view] you.

$150 USD in 5 days
(63 Reviews)
6.1
srinichal

I can do this in perl and deliver you soon

$150 USD in 2 days
(25 Reviews)
6.1
gangabass

I can do this job for you. See PM for details.

$60 USD in 4 days
(78 Reviews)
5.5
NishantBamb

Hello, please refer your PMB. Thank you.

$200 USD in 7 days
(22 Reviews)
5.3
agihcam

Check PMB.

$100 USD in 2 days
(40 Reviews)
5.2
alexander2007

Please check PM. Thanks.

$250 USD in 8 days
(25 Reviews)
4.7
Scorpio1987

Please check PM for more details..

$100 USD in 3 days
(9 Reviews)
4.4
yousefla

Hi, I'm interested in doing your project. Please contact me by PM if you like to discuss. Best Regards, Yousef

$195 USD in 3 days
(5 Reviews)
4.0
ancosys

Hi, Please check pm. Thanks!

$100 USD in 3 days
(3 Reviews)
3.7
rpdammu

Dear sir I am ready to start the work immediately. Sincerely Rajendra

$225 USD in 5 days
(6 Reviews)
2.5
InnoConsulting

Contact us for details.

$250 USD in 5 days
(2 Reviews)
1.0
arifkhl

I've so much experience on Excle Program. I can do this type of job so properly within short time.

$50 USD in 30 days
(0 Reviews)
0.0
ajinkya314

Please check my PMB.

$200 USD in 5 days
(0 Reviews)
0.0
hfeeki

I an expert in python for 8+ years, I have many web scraping experiences. I can do this job.

$55 USD in 0 days
(0 Reviews)
0.0
jaysharma61

Hi, i can do this job. please see the pmb.

$100 USD in 5 days
(1 Review)
0.0
selva207

Please visit PMB

$145 USD in 3 days
(0 Reviews)
0.0
radhai

ready to start here

$100 USD in 10 days
(0 Reviews)
0.0