Data duplication / Master database
I have ruby on rails website, which acts as a database for real estate agents (users). Each user collects personal information from their customer such as name, address, phone and email etc.
For every piece of information, in each user account, I want to be able to extract a master database, that would combine all possible information to create a comprehensive database.
For example, if user 1, 2 and 3 have the following records, the master should be able to collect all of the info in one record.
User 1 Steve 0276233139
User2 Mr S Guy 0276233139
User 3 Steve
15 Brown St
Master Steve Guy 0276233139
15 Brown St
The system should then be able to identify the customers with partial information, and all an administrator to offer the missing information back to them, and if desired, auto populate a users data with the available information. I.e. User 1 is missing 3 pieces of information for this one client.
The master database needs to create a record for every person found, plus one record for every property in New Zealand. For example, I may know an address but not the owner, and I may know a person but not where they live.
Large volumes of data in csv format will be added to the database from time to time.