Hi~ I am new to this platform. And I want to scrape more than 2~3M of urls.
I already written a script that only runs on MacOS which use App Script.
This is essential condition. Currently only single machine can run a single script.
So if you are an expert of App Script or you have multiple number of MacOS then it's applicable on this project.
The site is protected by “Distil Network” which makes scrapping real hard.
5 freelancers are bidding on average $205 for this job
I Could build you an application from which you can run multiple instances of your script. It's not easy, it's complicated, and therefore expensive, but it will work.