web crawler
₹12500-37500 INR
Paid on delivery
I am looking to create a web crawler that will extract specific data from e-commerce stores online. The goal is to collect text content, which needs to be cleaned and formatted so that it is ready to be used. I require a solution that will extract relevant information quickly and accurately - I will not accept anything less. If you think you have the skills necessary to deliver a successful project, then I invite you to submit a bid for this project. Thank you for your time!
This will require someone to
1. Crawl a parent page
2. Get all the links in that page
3. Hit that link and then get few data from the page
4. Create an excel with that data
Things to note ,
[login to view URL] should be some sleep Time introduced if there is continous hits the IP address can be blocked due to rate Limiting
2. Need a MultiThreaded application which can run parallel crawls, to make sure the crawling doesnt take hours ( 1 crawl could contain 1000+ links to hit)
3. If Program crashes/Needs to be stopped the previously crawled data should not be lost - One solution is intermediate writes
4. Open to run on local machine or cloud ( Ready to invest more if cloud can help scale)
Project ID: #37233719
About the project
15 freelancers are bidding on average ₹24537 for this job
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are look More
I understand that you are looking for a web crawler that will extract specific data from e-commerce stores online. The goal is to collect text content that needs to be cleaned and formatted so that it is ready to be us More
Hello, my name is Nitin and I am part-owner of SoftwareLinkers. We specialize in providing solutions for businesses that operate through the internet. I noticed you are looking for a web crawler that will extract spec More
Dear, Client Please let me know the e-commerce stores. I am thrilled to express my interest in your web scraping and automation project. I am confident in my ability to deliver outstanding results that align with your More
Hello I am a seasoned Scraping Expert with expertise in Python and JavaScript. I have extensive experience using BeautifulSoup, Puppeteer, and Scrapy for advanced web scraping and generating actionable insights. Here More
My name is Anees and I am experienced web and mobile app developer with 15+ years of experience. I have helped small medium and large scale businesses develop their websites, mobile apps, software and digital presence. More
Hello. I have a lot of experience in creating scrappers. Please indicate the data from which site and in what format you will need to collect. I use different libraries such as beautifulSoup, request, playwright, un More
I understand you are looking for someone to create a web crawler that will extract specific data from e-commerce stores online. The goal is to collect text content that needs to be cleaned and formatted so that it is r More
Hi! I have a lot of experience in web crawlers thanks to my OSINT software development past. Of course threading and Excel exporting is not problem for me I use them a lot when I develop data analyst tools. Feel fre More
