Closed

Web scrape an internet provider's website

I would like a web scraper to be used on the following website ([url removed, login to view]), preferably written in Python so that it can run on a Mac although I can be flexible on that. The scraper would loop over roughly 35,000 addresses and record various pieces of information. A priority is that the program operate in such a way that my IP does not become banned, or at least not until a lot of data has been collected. Below are the steps:

1. Visit [url removed, login to view]

2. Enter an address from a list I will provide you, for example "9920 Cherokee Rd" with zipcode “23235”.

3a. It returns a screen showing what options are available. Click “Shop all bundles”.

4a. Record the packages and prices as follows:

a;2-year price guarantee;Fios Gigabit Connection with Custom TV + Phone;$79.99/mo;for 2 years w/ 2-yr. agmt. Plus taxes, equip. charges, RSN, FDV and other fees & $12/mo. STB equip. charges. Up to 940/880 Mbps.;2-year price guarantee; Fios Gigabit Connection with Preferred HD TV + Phone;$94.99/mo;or 2 years w/ 2-yr. agmt. Plus taxes, equip. charges, RSN, FDV and other fees & $12/mo. STB equip. charges. Up to 940/880 Mbps.; …

2b. Consider this address: “98 Dartmouth Ave” with zipcode “19081”.

3b. It returns a screen saying “According to our records, this address already has Verizon services.”. Click ‘I want to set up new services. The current resident is moving out.’ and Continue. On next screen click Shop all bundles.

4b. Record the packages and prices as described above except note that the first entry is b instead of a.

b;2-year price guarantee;Fios Gigabit Connection with Custom TV + Phone;$79.99/mo;for 2 years w/ 2-yr. agmt. Plus taxes, equip. charges, RSN, FDV and other fees & $12/mo. STB equip. charges. Up to 940/880 Mbps.;2-year price guarantee; Fios Gigabit Connection with Preferred HD TV + Phone;$94.99/mo;or 2 years w/ 2-yr. agmt. Plus taxes, equip. charges, RSN, FDV and other fees & $12/mo. STB equip. charges. Up to 940/880 Mbps.; …

The program must operate in a way that doesn't get my IP banned or there is no point because I need to collect data from ~ 35,000 addresses. I have an account at 2captcha and an API key to bypass captchas if you require using it.

Thanks

Skills: Data Entry, Data Mining, Excel, Python, Web Scraping

See more: excel scraper, octoparse, best web scraping tools, web scraper tool free download, free web scraping tools, data scraping software, web scraper tutorial, web data extraction software, organizations website webmaster programmer web editor contents provider, red5 internet provider, internet store buyer website builder, web scrape perl javascript post, scrape internet phone number site, dtech internet provider bangladesh, web scrape net

About the Employer:
( 5 reviews ) Clifton, United States

Project ID: #15789398

44 freelancers are bidding on average $441 for this job

schoudhary1553

Greetings, I can help you in Web scrape an internet provider's website. Please ping me for more discussion. Please see my profile i have deliver almost 280 projects with 100% client satisfaction. Relevant Skills a More

$400 USD in 5 days
(213 Reviews)
7.3
DeepSyaal

Lets start. Having a team of Professionals. We provide high quality work with accuracy. Would you like to discuss more about your current requirements? Relevant Skills and Experience web scraping,data entry Proposed More

$388 USD in 3 days
(315 Reviews)
6.8
$555 USD in 10 days
(184 Reviews)
6.8
lkhelladi

Hello, I'd be glad to develop the scrapping tool for you using python . Looking forward to chat with you soon for more details. Best regards, Relevant Skills and Experience wen scraping using python is my primary More

$333 USD in 3 days
(104 Reviews)
6.6
sadekhosen77

Hello I am highly interested to do your project . I am confident about the work . Relevant Skills and Experience Python I believe that , I can do this work properly and in timely according to your instructions. Pro More

$500 USD in 5 days
(79 Reviews)
6.2
$555 USD in 10 days
(152 Reviews)
6.0
ATLASFSD

Hello, I would like to work on your interesting project and develop a scraper for [url removed, login to view] capable of using rotating proxies to avoid your IP getting banned. I am ready to talk about details. Relevant Skills and Ex More

$400 USD in 4 days
(47 Reviews)
5.7
shafaqat11

Greetings sir, I am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. I can do this task as per your requirement. Relevant Skills and Experience I have the 5 years of ex More

$277 USD in 10 days
(101 Reviews)
5.7
mdreju

I always try to work with honesty, dedication and punctuality to make sure that I deliver quality work in time. Relevant Skills and Experience Data Entry, Web Scraping Proposed Milestones $555 USD - On the project

$555 USD in 5 days
(33 Reviews)
5.5
asin1987

Dear Employer, I will scrap verizon for you and IP will not be blocked. Please give me a chance. Please read my reviews. Thanks!! Relevant Skills and Experience Web scraping Proposed Milestones $555 USD - Project

$555 USD in 10 days
(30 Reviews)
5.6
$250 USD in 10 days
(36 Reviews)
5.4
vigor87

Dear Client. This is Andrey from Russia. I have highly experienced with Web Scraping using Python looking forward to hear from you. Kind Regards Andrey Relevant Skills and Experience Data Entry, Data Mining, Excel, Py More

$555 USD in 10 days
(5 Reviews)
5.1
narsim3128

I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects which involved scripting, web scraping Relevant Skills and Ex More

$250 USD in 5 days
(35 Reviews)
4.9
$555 USD in 10 days
(10 Reviews)
4.7
$555 USD in 10 days
(17 Reviews)
4.4
pradeep1205

Hello sir/madam, good day, i read your job description fully... I have worked on similar projects to what you are looking for, and I am confident that I can exceed your expectations. Relevant Skills and Experience dat More

$250 USD in 10 days
(32 Reviews)
4.2
wayne4989

Hello, I have rich experience at web scraping for 7+ years. I'm sure that I'm able to complete your project successfully for my skill and experience. Relevant Skills and Experience I use Python, PhantomJS, Selenium, B More

$500 USD in 5 days
(7 Reviews)
4.0
$555 USD in 10 days
(15 Reviews)
3.4
Risalat1

Ready to work with you, could you please send me some more details about your project so we will estimate it accordingly.... Relevant Skills and Experience Ready to work with you, could you please send me some more de More

$388 USD in 10 days
(3 Reviews)
3.5
labibhasan01718

Hi, I am very much interested to do your offer. I am professional and vastly experienced in extracting data from different websites or anywhere on Google. Relevant Skills and Experience web scraping, data entry, data More

$250 USD in 10 days
(11 Reviews)
3.0