Completed

web scraper php script grab 30 fields from a page

This web scraper will dig though 2 levels of pages and grab data.. i have very clear instructions with real urls & visual mockup.. I can send via pm. Must be done in PHP. must be completed by 6/17/13 at latest

1) [url removed, login to view]

Start at this page and visit each state Link from the blue state text links, or from the pull down menu and press submit it. It will bring you to the following URL for Alabama for example:

2) [url removed, login to view]

&state= is the only querystring you need to send, as you can see it is the 2 letter state code. Technicaly you don’t need step1 if you index all their state codes manually. Visit every one of these links to get a list of all reps for this state & store the &member= code so you can visit each representative detail page directly. Grab the records highlighted and write to transfer_rep table

3) [url removed, login to view]

This is the detail page that we need to extract most information from. Each label is saved to a separate table field. Make each field name in the table the same as the label on the website, all lower case and use _ for spaces. “DC Address” = “dc_address” , “Contact Senator Shelby” = “contact_url”

4) For each rep found you need to search the name.transfer_rep and name_alt_search.transfer_rep fields to find a %LIKE% match. Then write back the data to that id if a match is found. If there wasn’t a match found, then it should create a new record id, and create a log of new id’s that were created and id’s that were updated.

transfer_reps table you will write to

Field name (all lower case)

id

active

Name

Image1

Contact_url

State_name

State_code

Dc_address

Dc_phone

Dc_fax

Homepage_url

Twitter

District_offices

Party_code

District_code

Scrape_member_code

Party_name

Leadership

Freshman

First_elected_to_office

Year_of_next_election

Previous_political_work

Committee_membership

Gender

Hometown

birth

Professional_experience

Education

Family

Faith

Organizational_memberships

Skills: PHP, Web Scraping

See more: page scraper script, use case levels, script to pull data from a website, php codes list, find reps, find php id of a website, find and search in php code, family id, example of a letter, education city, create id use all web, create a page web, clear search fields, dig web, index php id, twitter scraper, scraping twitter, php script create table, list of every active url, grab, visual web scraper, php script search extract urls, find twitter address, web data table extract, contact information scraper

About the Employer:
( 19 reviews ) brooklyn, United States

Project ID: #4621906

Awarded to:

iautomation

Hi there Matt. Can you possibly send the real link to me, so I can calculate? I've built many scrapers using php and cURL and can help you out with this. I can guarantee a quick and well done job. let's chat and I can More

$105 USD in 1 day
(23 Reviews)
3.9

8 freelancers are bidding on average $178 for this job

rajeshsonisl

Quality work assured. Ready to get started. Thanks.

$263 USD in 3 days
(374 Reviews)
7.0
VileGnosis

I have sent a private message to your inbox that contains my relevant skills and any questions I have.

$150 USD in 1 day
(173 Reviews)
6.6
tzo

Can help you on this.

$125 USD in 3 days
(197 Reviews)
6.3
sohel364

Hi, I have skill with crawling script. Read your details and can do it [url removed, login to view] check inbox for details. Thanks, Sohel

$166 USD in 1 day
(9 Reviews)
4.3
mohanchauhan

Please check private message for more detail

$226 USD in 3 days
(5 Reviews)
3.9
DanielleLC

Professional, accurate, and well-versed in your data set.

$222 USD in 3 days
(3 Reviews)
3.0
MaxwellZone

Please see my private message.

$166 USD in 3 days
(1 Review)
1.0
lisa23

I can do it in a better way

$222 USD in 3 days
(0 Reviews)
0.0