Beautiful soup data scraping of website

I am looking for someone with experience in Beautiful Soup and using it to scrape data.

I need a large directory site scraped, url given to those who PM me and ask. Leave a dummy bid and contact me.

There are approx 4 mil records.

There is some structure to the data.

The end result is clean data in a csv file. I need to be able to run this manually myself to get updated records.

There is Ongoing, lots of ongoing work, if you know what your doing and do it for a good price.

We will discuss this as part of your bid.

If you have another way to scrape sites that I dont know about let me know.

OK so I have had enough of my time wasted.
You are all now required to give me 2000 scraped items from the website I have given you via PM. This is to show me you can even join the conversation. To annoyed at the people trying to fool me.
The quote will cover the following.
1. Full scrape of over 4 MILLION URLS. Seriously, you start at ID # 1 and scrape to ID 4000000. Not rocket science.
2. Clean and organised data.
3. Something I can run myself, it needs to be open source, run on my server, and I need to be able to run it whenever I want update data, this may be daily, weekly or monthly. My choice.
4. Consider the banning of IP addresses and work out how you can incorporate proxies.
5. Dont ever ever ever ever ever consider trying to give me a price based on 1000 records. Its a sure fire way to get the flick. I have already scraped this data 6 months ago. I know whats involved.
6. Dont tell me you can do it, dont tell me how badly you need the job. I dont care if your neighbours fcriends brothers dog died and you need money to bury it. Im in business. You either can or you cant, and the only way to show me you can is to do it. Give me a 2000 records, show me how you did it and show me how you plan on handling my project. Work with me and we can buy 100 dogs to replace that little one.
7. Dont try and scam me with some fake bit of data, I am not stupid.
8. Im looking at scraping about 20-30 million web pages on various sites, this is a long term gig. Spend some time working through the info above and figure out if you want to deal with someone who has a clue, or if you want to move onto the next scam.

Skills: Data Mining, Web Scraping

See more: what is data structure in c, what is data structure, what is data in data structure, what is a data structure in c, what is a data structure, what data structure, what are data structure, web scraping price, web beautiful, directory web scraping, data structure that, c using data structure, beautiful web sites, beautiful sites, about data structure, beautiful soup scraping, what is data scraping, scraping a website, website scrape, website data scraping, We Scraping , url scraping, SOUP, data mining using, contact clean csv

About the Employer:
( 7 reviews ) parramatta, Australia

Project ID: #1161013

16 freelancers are bidding on average $89 for this job


We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$100 USD in 3 days
(26 Reviews)

I can deliver the script in python

$80 USD in 4 days
(25 Reviews)

### Expert here, please see the PM ###

$30 USD in 0 days
(27 Reviews)

Please View PM

$30 USD in 5 days
(17 Reviews)

Hello Sir, Kindly prefer my PM.

$30 USD in 1 day
(1 Review)

Hi, I can do it, please read the inbox for details

$30 USD in 1 day
(17 Reviews)

Hi, Please check PMB I have sent you sample of my past work. I am expert in creating Web Data scrapers, automated applications and have 3+ yrs of Experience in advance VBA programming, I ll deliver you the quality More

$30 USD in 0 days
(3 Reviews)

I have good experience with web scraping .. i use beautiful soup and scrapy framework if necessary , please go through my reviews..

$75 USD in 0 days
(3 Reviews)

I can do it. Please check your PM. Thank you. Regards.

$80 USD in 1 day
(3 Reviews)

Please see PMB

$30 USD in 0 days
(4 Reviews)

Ok, I understand. I can do it. I want to discuss more about my work. Check my PRIVATE MESSAGE for you. Thank you. Dev:)

$30 USD in 15 days
(3 Reviews)

Hi,Kindly check your PMB

$250 USD in 6 days
(1 Review)

pls check your pm

$50 USD in 2 days
(0 Reviews)

Check PMB boss. serious bidder. Senior Python expert programmer here.

$110 USD in 2 days
(0 Reviews)

Hi, Sir I Can Do This Project I Have Experience Check Your Pmb Thanks

$450 USD in 30 days
(0 Reviews)

Hello, Well Experienced Data Collector Service Provider Please Check Your Pmb. Thanks

$70 USD in 9 days
(0 Reviews)

I can do this

$30 USD in 1 day
(0 Reviews)