Closed

large data script needed - mysql, oracle etc - 2billion rows

This project received 37 bids from talented freelancers with an average bid price of $255 USD.

Get free quotes for a project like this
Employer working
Project Budget
N/A
Total Bids
37
Project Description

Hi,

We need a script making and running: It is a very simple script which compares 2 IDs / data to find related IDs. The script needs to run and store the results in another table with 3 columns: domain, related_domain, total_related

The script has to be run on a table of 1.7 BILLION rows. The final results table could be 10 - 15 billion rows

WE HAVE TRIED MYSQL AND IT IS NOT FAST ENOUGH. We need a different technology

Our server OS is centos. We need it to run on 1 server and complete in 24 hours. Our server is 2x hexacore, 192gb RAM, SSD drives.

PLEASE ONLY APPLY IF YOU HAVE WORKED WITH SIMILAR SIZE DATA

WORK TO BE COMPLETED URGENT

Thanks

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online