In Progress

White pages data collection

We require either software of a reliable script to collect data from a well-known Australian Telephone Directory. The site consists of 2 websites that we need to collect standard telephone directory information from.

In short we want to download all the data monthly in order to update our internal database. The data will most likely take a month to collect slowly.

Known challenges are as follows:

This site is smart and when it detects too many searches from an IP that IP can be blocked. As such it needs to use many proxy’s in a random approach in order to avoid being blocked. It’s also suggested that the script not push too hard and to pause every minute so to not be easily detected and blocked.

As an added smarts the site often changes the layout slightly in order to break dumb spiders that are expecting the format not to change. Your script should use some smarts in order to acquire the required data.

In order to get all the data out of the sites it’s suggested to throw at it random dictionary words on a state by state approach.

If you are interested in this project please send a PM for exact details of the sites. Only experienced programmers will be considered. We will close bidding the minute we reach a deal with a qualified bidder and we would like to see this project start quickly.

Skills: .NET, Anything Goes, CSS, PHP, Software Architecture

See more: white pages site, websites collection, software challenges, smart programmers, programmers dictionary, hard to approach, data challenges, spiders, net smarts, will white, so many pages, Database collection, data collection software, software monthly collection, approach minute, smart project database, proxy site update, month collect data, net data data, white order, telephone database software, format pages, random data, Telephone directory project , internal pages

About the Employer:
( 10 reviews ) Sydney, Australia

Project ID: #2568733

Awarded to:


Hi, Please see your PMB.

$300 AUD in 5 days
(3 Reviews)

11 freelancers are bidding on average $477 for this job


expert team to help you out. please check PM for work samples.

$550 AUD in 12 days
(24 Reviews)

HI, Kindly see details in PMB Thank you

$500 AUD in 5 days
(32 Reviews)

Dear Sir I am interested in working in this project. But I need the URLs first to send you a more formal bid. Regards Tamer Khalil

$300 AUD in 3 days
(14 Reviews)

I can do this with iMacros for Firefox. I've already done similar projects. see examples in portfolio or on my website [url removed, login to view]

$400 AUD in 5 days
(3 Reviews)

Over 16 years professional working experience for large UK firms

$700 AUD in 2 days
(2 Reviews)

Please check PMB

$250 AUD in 10 days
(11 Reviews)

Hello, We have been through the requirements as you stated. We are from netcore Info Solutions having a team of very highly experienced developers who had worked for many clients. We would like to work with you for More

$699 AUD in 15 days
(1 Review)

please check my pm

$250 AUD in 7 days
(0 Reviews)

hi, please see pm for details.

$300 AUD in 10 days
(0 Reviews)

Hello Sir, We are ready to [url removed, login to view] have done it [url removed, login to view] do not worry about [url removed, login to view] have scrapped similar sites like yellowpages,salesforce,[url removed, login to view] will do it for you ahead of [url removed, login to view] instructions would be More

$500 AUD in 10 days
(0 Reviews)

Custom software development: w w w . The Administrator removed this message for containing contact details which breaches our Terms of Service . i o

$750 AUD in 1 day
(0 Reviews)

"WE HAVE SCRIPT READY FOR YOU" We are expertise in creating scraper, crawler, extractor & many more..We are new in freelancer so we don't have review here but reviews in other freelancing sites..Please check PMB for d More

$750 AUD in 5 days
(0 Reviews)