Web Crawler Software


I'm looking for a programmer in either PHP or Ruby (Rails) to create a web crawler. The idea is to crawl domains for it's Google Adsense, Analytics ID, etc. and store them in a database.

Details to be stored are:

1. Web IP

2. Analytics ID

3. Adsense ID

4. Amazon ID

Also, you will need to present it on a HTML site (can be basic) and a table with results. Needs a backend to control sites/users (yes, needs authentication against a database).

Also, if the domain is not crawled upon search, crawl and store the domain.

You can have more details here:

[url removed, login to view]

Please quote for all this.



If this is not something you are interested in or it the budget does not match your desire/skills please DO NOT BID.

Once again WATCH THE VIDEO and you will understand what I need. It's really not that difficult and it will save a lot of time to both parties.

If you need further details after watching the video and reading the whole description, please do not hesitate to contact me and I'd be more than happy to give you more details.


Skills: MySQL, PHP, Ruby on Rails, Software Architecture, Web Scraping

See more: software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, software write book images, software write books, software write protection, free software write book, software write book, software cloning web sites, transform windows software solution web based solution, web hosting sites can add aucation site, software panners web, software bikin web desing, software related social bookmarking sites india, web sms sites

About the Employer:
( 3 reviews ) Santiago, Chile

Project ID: #11251735

10 freelancers are bidding on average $197 for this job


Dear Client, I can help in your project. I have already experience of working on similar projects. I am expert Data Scientist and have expertise in data mining, web and data automation, I can develop automated b More

$155 USD in 7 days
(283 Reviews)
$250 USD in 5 days
(53 Reviews)

Dear Sir, Hope you are doing well today, I have read your project description, i am willing to do this task for you. i have done similar work before and got a good review. please come on chat, so we can disc More

$155 USD in 3 days
(10 Reviews)

Hey there ! We're 2 developers with vast and wide knowledge in PHP and scripting specializing in Web scraping. We'll gladly do your project as it seems like something we can pull-off quite easily. Contact us for furthe More

$278 USD in 1 day
(10 Reviews)

Hi, I am interested in your project and ready to start now.I know I am new freelancer so its hard to trust on me so just create milestone and release when job done upto your satisfaction. Here is few wordpress More

$155 USD in 3 days
(10 Reviews)

Hi, I am a full stack rails developer with having 5 years of extensive experience. Have strong knowledge in rails and using many gems, and also strong in using HTML, Javascript, JQuery and GIT. I have worked on More

$222 USD in 3 days
(1 Review)

Hello, I have a good experience in web scrapping, you can check that by reviewing my past projects here, if you like I can send you a simple of data I scrapped: [login to view URL] http: More

$177 USD in 3 days
(4 Reviews)

I am a full stack ruby and rails developer with 1.7 years of market experience. I have worked on web crawlers in ruby on rails. I will provide you the link if you need Here is my linkedin profile: [login to view URL] More

$155 USD in 3 days
(0 Reviews)

We are a small team of developers who have a lot of experience with backend programming using PHP, Ruby, and Python. Your project sounds interesting. So, we'd like to work with you.

$222 USD in 7 days
(0 Reviews)

I'm a Software Engieneer in Programming, I have 8 years of experience, I have a business with 10 employes and we usually work on complex web based projects. Also, personally I've made lot of bots(spiders) projects. I n More

$200 USD in 10 days
(0 Reviews)