I need a fast search engine crawler to crawl the web and find websites that fit the simple algorithym (I will assit the programmer with details) and store the --> web addresses <-- NOT CONTENT that fit the simple algorithym in a database or text file. The web crawler should have many threads and should be able to crawl many websites everyday. (When submitting your bid please specify the number of pages the crawler will do per day) I should also be able to specify if I want a specific page to be crawled. I need this ASAP so be specific in your bid times. Also, I will not pay until I am completely satisfied, every time I have prepaid I got ripped off.
Be detailed in your bid or I will ignore it.
--- DO NOT BID IF YOU CANNOT CREATE WHAT WE NEED ---
------ DO NOT BID IF WE HAVE PREVIOUSLY FIRED YOU ------
If you are good and can complete this project we will give you first chance on future projects.
Project ID: 13343
About the project
4 proposals
Remote project
Active 19 yrs ago
Looking to make some money?
Benefits of bidding on Freelancer
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
4 freelancers are bidding on average $415 USD for this job
We have the crawler's core ready for you, just need to have it customized to your needs.
If you want so see it in action, we can provide a link to the demo version, not polished to your needs yet.
If you have more data about the project please make it available and feel free to ask any questions that you may have.
Have a nice day !