Once a page has been identified i just want to store the domain name in to a mysql server table. the nature of the code means that we actually probably only need to search the main home page if it is easier and store the domain name just once.
I want the crawler to just do it's own thing and be left alone to run, and follow link from link, also if it could be set up to look for more than one block of code at a time even better or if i simply need to run multiple crawlers not a problem.
Please note i am away for the rest of the week and so will not award the project before Monday.
6 freelancers are bidding on average £156 for this job
I have carefully read your requirements and I can assure you quality [url removed, login to view] refer to my private message for further details. Best Regards