Web Scraping Project


I’m looking for a web scraping expert to help me with a solution to a scraping project I have. The final solution can use something like beautiful soup or scrapy.

Overview: Given a list of urls in a txt file the script will go to each url and scrape certain information from those pages. (I will use scrapebox to get the list of urls)

The script must have the following features:

1. Allow me to enter in multiple footprints to scrape multiple items from the url

2. Enter the scraped data into a csv file that can be imported into excel. (each footprint would enter the data in a different column )

3. Allow me to use multiple proxies to do the scraping

4. Some protection from banning. (set delay between requests, rotate user agents, disable cookies option)

5. A log file and error log file

6. Email notification when script is done or a “keyword trigger” is scraped for a footprint (with csv file attached to email)

7. Work on a linux vps

Of course you will need to show me how to use your script, so good written and spoken English communication skills are essential

Skills: BeautifulSoup, Data Mining, Python, Scrapy, Web Scraping

See more: web scraping: doing 20 real web scraping projects download, python web scraping projects, web scraping jobs, python web scraping ideas, web scraping project report, web scraping tutorial, web scraping projects github, python web scraping project ideas, web scraping visual basic, disney web design project, bid web video project, receive sms web base project php, deployment dot net web mobile project pda, web scraping flash sites, web design project outline, aspnet web development project dubai, php web design project shopping cart orders users, web scraping project, web scraping project payment amount, estimation web scraping project

About the Employer:
( 13 reviews ) Brampton, Canada

Project ID: #17952777

Awarded to:


That's a pretty detailed project, for once. The exact details may be discussed privately, but other than that, it sounds reasonable for the most part. Contact me if you're interested.

$100 USD in 7 days
(9 Reviews)

18 freelancers are bidding on average $160 for this job


Hello. I am expert in web scraping, data mining and have more than five years of experience in this field. I can scrape any type of website as I have a team of professional developers. please send me website you want t More

$155 USD in 3 days
(163 Reviews)

Hi I have mastered scrapping and I have already done like this job. My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills wi More

$155 USD in 3 days
(77 Reviews)

Greetings! Dear sir,I believe honesty is the best policy. My main target is to supply high-quality work with reasonable cost. I am expert on Email Collection, Data Entry, Internet Research. I have more than 4 years More

$50 USD in 1 day
(154 Reviews)

Hi. I saw your description carefully and I think I can help you. I'm Web scraping expert, I have more experience in python web scraping. if you want to know more imformation about me ,please see my profile. Scrapin More

$100 USD in 3 days
(21 Reviews)

Hello there, I have more than 10 years of experience in data scraping and analysis. What do you mean by instrument ?

$100 USD in 2 days
(9 Reviews)

Hi there, I am java developer. I have strong expertise in web crawler, web scraper, b-o-t-s and web automation. I have already made similar scrapers and b-o-t-s for facebook, Amazon, eBay, bet365, Rightmove, Zoopla More

$350 USD in 3 days
(8 Reviews)

Can make Scrapy framework with scheduling integration. Will rotate proxy and provide you results. can be run with argument These are my skills related to web scraping and crawling Have done scraping in CasperJS Phan More

$277 USD in 3 days
(27 Reviews)

Hello mate, I checked requirement and i think this is you need: + i’m looking for a web scraping expert to help you with a solution to a scraping project you have I have ability to do this project: Scrapy, Data More

$165 USD in 3 days
(13 Reviews)

Hello I am interested in your project. I'm a senior developer and Scraping expert. Web scraping is my skill, and I can do your task perfectly in a short time. I can scrape by PHP or Python. I can save data to .cs More

$100 USD in 3 days
(7 Reviews)

Hello, Sir. How are you? I have experiences more than 9 years in developing Laravel,node.js,angular.js,react.js and Python Frameworks with mobile apps. I will work for you all my best. Thank you in advances for your More

$140 USD in 3 days
(3 Reviews)

Hi, there. I am an experienced web developer, and web scraping expert. I read your job description, and I am interested in your project. I have good experiences in web scraping using PHP, Python(BeautifulSoup, More

$133 USD in 3 days
(2 Reviews)

"Hi, I have just gone through your project description and reviewed everything. Yes, I’m able to work as per your stated requirements in the Web Scraping project. Also, I'm able to provide accurate and quick service. More

$50 USD in 3 days
(4 Reviews)

Hello there! Allow me to complete this task. I can show you some of my scraping scripts if you want me to. Please ping me so that we can discuss more and I can start off my work right away :)

$200 USD in 3 days
(1 Review)


$150 USD in 5 days
(0 Reviews)

Hi There, I have understood your requirements. I am a Web Research/ Data Research and data Uploading specialist. I have years of experience in managing, updating researching & adding Online data records on CRM. I a More

$130 USD in 2 days
(1 Review)

Dear client, Thank you very much for viewing my proposal! I have great experience in web scraping and data mining. I will use Python as my primary tool for the project. I am an expert at Python and its various More

$200 USD in 4 days
(0 Reviews)

hey well bro. I am really good for this project. I am currently working on scrapy and beautiful4shop in my company. and having around 1 year experience. you will surely get quality and accurate work from my side.

$333 USD in 2 days
(0 Reviews)