Web Application - Keyword Research Tool - Scrapes Google Keyword Tool

Budget $3000 - $5000 USD
Bids 40
Average Bid $4931
Status Closed

This is an overview of the project, please read the attached text file for a full description.

This job would require a team that would be able to work with me on a long term basis, as there will be additions & changes to the application as it grows & evolves. I don't want to be left in a lurch trying to hire a new team to "learn" what another team had coded, and then trying to fix/add-on to it.

Most important things for this project:

Speed – This web application needs to be lightning fast. Obviously a dedicated server(s) will be needed for this application to function properly, but the code itself needs to be written very well and in such a way that this application can analyze millions of keywords very very fast. This is by far the most important thing that needs to be focused on. I'm thinking that multi-threading is going to be necessary to achieve the speeds the application needs to have.

Scalability – This application will eventually end up with a lot of users, but at first it will be just a few. I don't want to end up spending thousands of dollars on hardware that would be overkill in the beginning. As this project grows, I'd like whoever wins this job to "grow along with it" and continue making improvements and scaling it up as more and more users use the application.

Lots of Users – This application will end up having hundreds, if not thousands of users. The code needs to be able to handle that kind of a "load" without crashing or losing data.

You'll need to have a working knowledge of using API calls, as this application will utilize Majestic SEO to get backlink data, and they have an API that will need to be used to get that data.

Looks – This application will need to look very professional, and not "thrown together" & "cheap" looking.

I've separated this job description into two parts. The first part is the "overview" where you can get a quick idea of what is needed, and whether or not you should take the time to bother bidding. The second part goes into GREAT detail going over exactly how the application should function when finished. You can read the detailed version which is here as an attachment called "Job [url removed, login to view]"

Application overview:

I need a web application that users log into to perform keyword research. The application will have two separate "modules" or "areas" with each module performing a different function. The two modules will be:

Keyword Research

Keyword Competition

The "Keyword Research" module will need to allow users to manage lists of keywords that can be as large as two million line separated entries long. They should be able to either copy & paste their keyword lists into the browser, or upload text files containing keywords in them. This module will then get Google AdWords data for each & every keyword. Then the user should be able to "filter" out keywords to keep/discard based on the data that was scraped. The user can then choose what keywords they would like to "move over" into the "Keyword Competition" module to do further research.

The "Keyword Competition" module will need to then search every keyword that has been moved over from the "Keyword Research" module into the "Keyword Competition" module on Google and grab the top ten search results. Then, for each of those top ten search results, it will need to analyze certain things about them.

Scraping Google is NO EASY TASK, I've had other developers try & fail. It is complicated, and requires a high level of skill to do it at the speed and efficiency this application will require. Only skilled developers need apply. I do NOT want to use the Google API. It must scrape Google. I understand this will require proxies to do it effectively & fast.

The pictures I've attached of a "sample" UI, are there simply for reference and to help explain my job description. You will have "full creative license" to develop a useful, intuitive UI that does what my job description has explained.

Get Free Quotes For A Project Like This

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • joeguo Profile Picture


    Jinan,  China

    Over 10 years Java & Python experience,2 year Go experience. Specialized in backend development, performance tuning, and domain data mining. Over 30 Joomla extensions have been developed. Some frameworks & softwares I am using: Spring, Hibernate, Lucene, Freemarker, Flask, Joomla, Linux, MySQL, Nginx, Apache etc.

  • committed Profile Picture


    Lahore,  Pakistan

    We provide Top quality HUMAN translations in all worldwide languages. We also provide Multilingual Website development and eCommerce solutions. We are also providing Customized and new application development which doesn't exist yet but in your mind. We are your one-stop reliable multilingual service providers.

  • HighEndSolutions Profile Picture


    delhi,  India

    MindCrackers Software Solutions is an Offshore Web site Design and Development Company with head office in Faridabad/India. We have a team of 30+ Skilled, Hard Working, Committed and Experienced professionals. Our team comprises of 8+ PHP Developers, 4+ DotNet/ASP/ASP.Net Developer, 5+ HTML/XHTML/CSS/JAVASCRIPT/JQUERY Coders, 4+ Creative Designers/Flash Experts/PhotoShop/ImageReady/CorelDraw Experts, 4+ Flash/Flex/AS 2.0/AS3.0 Experts, 2 Project Managers, 2 Team Leaders and 2 Quality Control/Debugging Professionals. We offer High End Soltuons in Web site design, logo design, Custom shopping cart, Content management systems, customization of oscommerce, creloaded, zencart, phpbb, wordpress, phpfaq,joomla,Dzoic Handshakes, Dzoic, ClipHouse, Jamit Job Board, Jamroom. We have a very satisfied customer base and our portfolio speaks for itself. Our main objective is to develop High Quality Secured software and Custom build application at Affordable cost with Quality and Commitment. We have a global client base in countries like India, Australia, USA, UK, Sweden, Denmark, Netherlands, Spain, Cyprus, Ghana, Nigeria, Greece, Canada, Israel, France, Germany, UAE, Singapore, Hong Kong, Malaysia, Belgium and other European/Asian countries. Our Technical team is Highly Qualified and having expertise in Custom Applications Development for various industries. We are expertise in following areas: Website Design Shopping Carts Custom Shopping Carts Logo Design Flash Design Flex/Flash/AS2.0/AS3.0 We Have specialization Team for :-- Dzoic Handshakes Dzoic ClipHouse Jamit Job Board Jamroom OS Commerce CRE Loaded Zen Cart Joomla Mambo PHPBB Forums Word Press Blog PHPFAQ'S We have also a expertise team for :-- Payment Gateway Integrations API's Integration Online Data Synchronization Database Merging/Migration Server Transfers By using our services you can be assured of the following things: 1. Creative Designs and Content that will grab the attention of the users. 2. Timely completion: we don't take on more than what we can handle and can deliver on Timelines Set by Customer. 3. Cost-Effectiveness Solutions: We would love to have few clients with thousand of projects instead of having thousands one time clients. 4. An honest job: We will keep your best interest in mind and work with integrity. Try us out at once and you will know why our clients continue to working with us. Kind Regards, VT

  • dinotech Profile Picture


    Jodhpur,  India

    Our Company is an India based web design company with great skills and a talented team. We are a multi-disciplinary and experienced team of engineers in different fields and are devoted to our efforts to provide our clients with the necessary requirements for the project. We collectively work as a team, which has resulted in building lasting relationships with the client. We are confident that regardless of the size, scope or complexity of your project, we shall be able to perform to your exact requirements. Our company is a website design company focused on developing a high end profile for both small and large companies. No matter if they're building a first website from scratch or wanting improvement to their existing website, we can do it.

  • iodaps2012 Profile Picture


    West Jakarta,  Indonesia

    I'm an Indonesian web developer based on city of Indonesia, Jakarta. I'm an experienced web developer reliable, hardworking, flexible, and honest. My website made from scratch. client satisfaction is my top priority. and i'm looking forward for our partnership. Thanks, Antonio

  • SigmaVisual Profile Picture


    Taxila Cantt,  Pakistan

    Web, Bots, Crawlers, and Scrapers Development. I have expertise in automation services and I can automate any manual process.

  • SoftSandila Profile Picture


    District Sheikhupura,  Pakistan

    We do all kind of web development, with php/MySql as well as in .net We specialize in providing solutions to our clients using many of the open source platforms available, i. e wordpress, joomla, zencart etc We do Blogs, CMS, E-commerce sites, online shopping carts We innovate for your business

  • srinichal Profile Picture


    Hyderabad,  India

    Perfection and dedication are the way we deal with projects on freelancer. There have been many clients all over the world that are satisfied with the solutions provided.All types of automation works along with web based solutions are our expertise. Looking to provide solutions in the Mobile markets as well. Some of the automation tools are listed in portfolio and here as well: * AutoBidder tool for Madbid like sites * Automation tools For all emails and social Bookmark sites * Social Bookmarking tools * Facebook Likes Automation * Webbased Versions of tools tailored to custom needs * Desktop apps tailored to customer needs * Proxy tools tailored to your requirements. A dedicated team that can literally deliver any project solution with high expertise. Please don't hesitate to contact us via freelancer. Satisfaction guaranteed solutions delivered all over the world. The Skill Set ranges from C# to PHP, Iphone to Andriod. We can deliver almost any solutions for your needs. We can also take up any type of work based on web design to desktop or mobile in the broad spectrum as we always strive to learn and perfect.

  • superior5 Profile Picture


    karachi,  Pakistan

    I am expert in Software and IT consultancy. I have got 10+ years of experience in technology.

  • webhealer Profile Picture


    Istanbul,  Turkey

    For about 11 years, I was working in digital web agencies as a web developer. I found a new way by using Freelancer.com. Currently I am working as a freelance web developer on Freelancer.com. I like coding and taking responsibilities. I use Php, Asp, , Html and Javascript. If you need a dependable, honest and dedicated person then you are in right place.