I’m looking for a web scraping expert to help me with a solution to a scraping project I have. The final solution can use something like beautiful soup or scrapy.
Overview: Given a list of urls in a txt file the script will go to each url and scrape certain information from those pages. (I will use scrapebox to get the list of urls)
The script must have the following features:
1. Allow me to enter in multiple footprints to scrape multiple items from the url
2. Enter the scraped data into a csv file that can be imported into excel. (each footprint would enter the data in a different column )
3. Allow me to use multiple proxies to do the scraping
4. Some protection from banning. (set delay between requests, rotate user agents, disable cookies option)
5. A log file and error log file
6. Email notification when script is done or a “keyword trigger” is scraped for a footprint (with csv file attached to email)
7. Work on a linux vps
Of course you will need to show me how to use your script, so good written and spoken English communication skills are essential
That's a pretty detailed project, for once. The exact details may be discussed privately, but other than that, it sounds reasonable for the most part. Contact me if you're interested.
18 freelancers are bidding on average $160 for this job
Hello there! Allow me to complete this task. I can show you some of my scraping scripts if you want me to. Please ping me so that we can discuss more and I can start off my work right away :)
hey well bro. I am really good for this project. I am currently working on scrapy and beautiful4shop in my company. and having around 1 year experience. you will surely get quality and accurate work from my side.