optimize a code that process large data

there is a code which is tested worked in small data, looking for someone to optimize the code to process large data from database using any option i.e. multithreading, multiprocessing, splitting in chank or any other method you know.

What the code do?

there is two database (sqllite db)

it takes two table from first db the column IP and look on second db table if it can find the same IP there.

Skills: Python

See more: how to handle large data sets, dask large datasets, reading large csv files in python pandas, big datasets, working with large datasets in excel, handling large datasets in python, machine learning large datasets, how to read large data in python, excel large data files, visual basic code extract excel data, source code export sql data csv file vb6, adonet sql large data excel export, sample code generate fake data, php code mysql export data microsoft word, check check code process design, sage data import problem look, php output large data, mysql load large data files, mysql large data import, mysql import large data xml

About the Employer:
( 0 reviews ) Berlin, Afghanistan

Project ID: #18857080

Awarded to:


Good day. How many rows database has? Do you use indexes? Can you send me a sample of the code?                         .

$25 USD in 1 day
(2 Reviews)

4 freelancers are bidding on average $30 for this job


I'm a software engineer. I have done this type of work many times. I have experience with this. give me full details. so I should start your work.

$25 USD in 1 day
(5 Reviews)

What are the hardware constraints? What are the software requirements (i.e., are virtualenvs required, or are system packages able to be installed? Linux or Windows?)? I've got nearly 7 years Python development expe More

$35 USD in 1 day
(0 Reviews)

I am a Phd Student in Big Data and deep learning, i will optimize your code by ussing big data technologies if you have a cluster or by multithreading, i am interested on this job, just count on me you wouldn't be disa More

$35 USD in 10 days
(0 Reviews)