large data script needed - mysql, oracle etc - 2billion rows

Budget N/A
Bids 37
Average Bid $255

Hi,

We need a script making and running: It is a very simple script which compares 2 IDs / data to find related IDs. The script needs to run and store the results in another table with 3 columns: domain, related_domain, total_related

The script has to be run on a table of 1.7 BILLION rows. The final results table could be 10 - 15 billion rows

WE HAVE TRIED MYSQL AND IT IS NOT FAST ENOUGH. We need a different technology

Our server OS is centos. We need it to run on 1 server and complete in 24 hours. Our server is 2x hexacore, 192gb RAM, SSD drives.

PLEASE ONLY APPLY IF YOU HAVE WORKED WITH SIMILAR SIZE DATA

WORK TO BE COMPLETED URGENT

Thanks

Post a Project Like This

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project