I need a little custom spider to crawl a website (only the index) and get some information of it to insert in a database.
I need to grab the following data:
- Title (# of words, # of characters)
- Meta Keywords (# of words, # of characters)
- Meta Description (# of words, # of characters)
- Meta Author
- IP owner (organization)
- Country of the server (Using maxmind database - geoip_country_code_by_addr)
- Host name of the ip
- DNS servers
- Alexa rank
- # of links to other sites (outbound links)
- Rss url (if have)
- # of fb likes ([url removed, login to view])
This code need to be a function easy to use only putting the url as a parameter, I need retreive all collected data as an array. Example: $spider_info = spider_function('[url removed, login to view]'); Return: $spider_info[title], etc.
Also, I need another simple function to grab some google results (only the url of the serps) for certain search. Example: Grab from 0 to 1000 results of the search "php" but only grab the url of websites on the serps. grab_serps('php', '0', '1000'); to put on a mysql database.
Thanks for your offers.
10 freelancers are bidding on average $175 for this job
Morning, Writing the spiders is one of my hobbies, believe me its fun. I have written quite a lot in different languages. If you are interested, I will do it for you. I will guarantee the quality of the code.