I have many mysql databases and each database contains many tables. The whole databases and tables contains TENS OF MILLIONS of records, but the problem is there are many duplicates among these records. So I built a php script to remove the duplicates, but it is very slow. Anyway, you need to read the following:
1- Your main job is to find a fastest way to remove the duplicates from all tables in each database, and you have to give me a feedback about the speed.
2- I prefer to get 1 (.exe) file written in perl or any good language, the file should get instructions from me to remove duplicates from a specified database or from all the databases. Ex: if I enter the name of DBs (db1,db2 ...etc), it can be start removing duplicates from these specified databases, or if I enterd (*), it can go and remove duplicates from all the databases that you specified in the code in advance.
3- I'll give you a PHP script to build the databases and tables automatically, and sample file of millions of records with a script to insert these records to the databases.
4- After completing the project, I need to test it using Teamviewer or any other way to make sure that it is meet my requirements and to check the speed too.
5- $30 - $50 is my max budget.
6- When you bid, please send me your thoughts about how we can get this job done.
20 freelancers are bidding on average $44 for this job
Hi, With over 8 years experience with PHP and MYSQL, I suppose I can fix your problem. How can we go on so I can take a look in your database, structure etc. Regards, Jeroen