Clean a database file with >30 million records

A proposal has not yet been provided

Hi There, good day! I have done this cleaning job in the past, i am good at excel and data handling. Will create master file with all unique records in-them. Will remove all duplicates and align the data in proper order. Am good at excel, formulas. let em knwo if i can do this for you. Thank you Anupama.

Dear Sir/Madam, My bid is on higher side as I know the pain in handling huge amount of data especailly when this is excel file. I have 20 years of IT experience and mostly in Database, Oracle, Sybase, Postgresql, SQL Server and MySQL. My brief background: I spent 13 years in USA as senior DBA mostly in US federal bodies like SEC, NASA, SBA, and FCC. I have great references from them. I also worked at Citibank singapore on behalf of Nucleus software. Here is the approach which I am going to take: 1. From each excel file I will upload the data into MySQL in all text field to contain all leading zeros without any primary key. 2. Will remove all the rows with blank primary key (IDNUMBER) 3. Will move all the distinct rows in a separate table or delete the duplicate rows if I find any search criteria for the duplicate. 4. Finally will create Primarykey on the filtered rows. If index created successfully then everything should be fine. 5. Export in a file and will send the mysql database backup(dump) Appreciate your attention. Warm regards, Pranesh Sinha

A proposal has not yet been provided

I've already worked with CSV files, that means import through a PHP Script into MySQL. I'm also pretty good with this DBMS. As Software Engineer this is a very easy task for me. Ready to start ASAP !!!