I need you to develop some software for me. I would like this software to be developed for Windows using Python.
I need to have a custom web crawler that can capture all the same fields as Screaming Frog SEO Spider (Title, Description, HTTP Status, etc.) but, gives me the flexibility to choose which fields to capture and when.
I also need the bot to export all data to Excel and CSV.
I need to the bot to be able to capture HTML elements on a page using XPATH.
I need the bot to be able to crawl JS heavy pages.
I need the bot to. E able to throttle up/down depending on my preferences.
i need the bot to be able to crawl at least 100M pages without any issues.
20 freelancers are bidding on average $206 for this job
Hi, I have done several projects similar with this. Please view my portfolios and contact me to discuss your project. Let me know the details via interview. Thank you. Regards,
Hi, Dear. My name is Fang G. Nice to meet you. I've read your post carefully. I'm Python/Web expert. We can do discuss more details on chatting room. Regards.
How are you? I read your description. I am C++/C#/Java/Python programming Expert. I can finish your project quickly with best quality. I want to discuss more on chat. Thank you for your time.
Hello? I have read your job description very carefully and i understood what you want. I have python selenium experienced for 4 years. I want to discuss with you via chat. Thanks you. James.
Hi, I've done similar work in the past. This is worth more than your budget, hence why I bid more. If you want the project done right, PM me to discuss and we'll get started.