[URGENT] Wordpress plugin expert needed [SCRAPER}


I have a wordpress plugin that works by scraping google for domains then checking them to see if they are expired and can be re-registered.

The plugin is fully developed and "works" But I need an expert developer to come in and make it faster, better threading, and better processing of proxies etc.

You need to have good experience in developing scripts and plugins and hopefully scraping type plugins.




The purpose of this plugin is to scrape data from google – we input a search term and google will search the web for websites that include this search term. The plugin will then take all of the search result websites and scrape them for URL’s – external links. The plugin then checks all of the domains it’s scraped to see if they are dead/expired and can be registered.

The plugin does this through a 2 stage process – DNS then Whois checking. It checks to see if the domain is currently hosted somewhere (Very fast) if the website is not being hosted, then the plugin does a whois check (slow) – through this, we can then eliminate the slowness of the whois check by only using it to check a small % of the domains it extracts.

The plugin then displays the domain as AVAILABLE and will show up live in the “Domains found so far” box and also at the end once it’s finished checking – in a downloadable excel format. The plugin supports multithreading so it will be searching/scraping/checking all at the same time and will display live domains as it finds them.

The plugin has been developed to run on Cron jobs – so this plugin can be run on any sized host – shared/dedicated etc. We want this plugin to be able to support very large multithreading without timing out the server etc. Essentially, it should run on multi threads that allow us to search hundreds of keywords and utilize thousands of proxies at the same time




Currently, the plugin seems to have speed issues and it’s not displaying outputs properly.

We need a new proxy checking mechanism – the checker should check all the proxies and start running searches as the proxies come back as LIVE – so we start getting “dead domains” asap, the object of this plugin is to get results as quickly as possible. The checker should run as many threads as there are proxies, ensuring fastest speeds possible.

I asked for a blacklisting functionality to be integrated – when it searches and checks a domain, if the domain is LIVE and can’t be registered, then it goes into a blacklist that ensures that the domain won’t be checked again if it shows up again in another search run. This has been coded in already, but not utilized – please get that working.

That’s all there is to it really, the other functionality is already there – custom search range etc, we just need to establish why it’s not working exactly right, earlier alpha versions of this from my previous developer were working fine, but they just had speed issues.

I need you to go through and get it up to scratch allowing fastest processing possible and ensure it works properly and we will be good to go. So half your job will be debugging then some quick fixing at the end :)

So, can you do this? Price and timeframe?

Skills: MySQL, PHP, Web Scraping, Website Design, WordPress

See more: wordpress web developer support, wordpress expert support, wordpress expert price, wordpress expert plugin support, wordpress expert jobs, wordpress developer support, why google is better, websites developer on wordpress, website debugging expert, web developer wordpress jobs, web developer wordpress job, web design is dead, searching websites design, searching for a web developer, price of a small wordpress website, need quick web developer, multithreading jobs, live support jobs, live-in jobs, live in jobs, jobs wordpress developer, jobs without experience, jobs using excel, job for excel expert, i need a wordpress website expert

About the Employer:
( 134 reviews ) Lilydale, Australia

Project ID: #4364930

16 freelancers are bidding on average $592 for this job


Check your PMB for details!!!

$750 USD in 18 days
(75 Reviews)

Lets do it

$500 USD in 9 days
(128 Reviews)

Hi sir, please check PM, thx Kimi.

$619 USD in 6 days
(175 Reviews)

I have all skin to done this for you. Please contact with me and check previous project about scrapper data https://www.freelancer.com/projects/PHP-Data-Entry/scrape-amp-convert-video-sources.html https://www.free More

$750 USD in 7 days
(104 Reviews)

We have more than 5 years of experience in wordpress where we have done lots of theme designs and custom plugins development. We can do your work easily.

$588 USD in 10 days
(102 Reviews)

Hi, we have expertise in HTML5 / CSS3 (Mobile Browser Compatible & Responsive), jQuery, PHP/MySQL, .Net, OsCommerce, Wordpress, Joomla, Drupal, Magento, ZenCart, Mobile Apps etc. You can see more details with PMB, Than More

$750 USD in 15 days
(40 Reviews)

hi, please find the attached private message of the work done ....Thanks!!!

$550 USD in 15 days
(61 Reviews)

Hello Please read more than private message thank you

$500 USD in 5 days
(45 Reviews)

Hi, I'm the best person for your job! Please, see PMB.

$750 USD in 10 days
(7 Reviews)

Ready to Start, Will Try to Give You Our 100% Effort for Your Satisfaction with our Service. Please check your PMB.

$500 USD in 7 days
(14 Reviews)

I've read your requirements and I clearly understand the job.I can do it.Please check your PMB.

$600 USD in 10 days
(18 Reviews)

ready to start the project. I want to introduce our self, we are a group of freelancers we have 11 year of experience in web application development and design for different domain, please go through the attach More

$500 USD in 17 days
(10 Reviews)

Hello Sir, We have gone through the details you have provided and would be pleased to work on this with you to deliver the results that you have expected and We are sure you will not be disappointed if you give us More

$500 USD in 15 days
(11 Reviews)

Ready to start. Thanks

$450 USD in 5 days
(16 Reviews)

Dear Sir, Greetings! We are WeExcel Technologies Pvt. Ltd with 10 years of experience under our belt. We are really interested to work on your project. Please see PM. Thank you. Regards, WeExcel.

$500 USD in 10 days
(2 Reviews)

I have 3 years experience with the use of php and javascript programming for web applications. I am familiar with developing wordpress plugins and web scraping. It sounds like you need help with parallel processing in More

$400 USD in 5 days
(5 Reviews)

Hello Sir, We have worked on similar requirements earlier. Please check your PMB for more details. Kind Regards

$825 USD in 12 days
(2 Reviews)

Hello Sir/Mam, We ensure the quality as its the key to success. Thank you, Group,

$650 USD in 25 days
(1 Review)

We are exert in Wordpress. We look forward to work with you! Lets discuss in PM!

$390 USD in 5 days
(1 Review)

Hi, We are one of the best developer on freelancer. We can provide you an excellent solution as we are professional and experience. We can develop your desire application within timeline. Read my PM for your ulti More

$800 USD in 10 days
(0 Reviews)