build a KDB nightly updated database

Project requires building a KDB database optimally partitioned and segmented from historical data set; and a process that would update the database nightly from flat files. It should not take too long for a KDB expert to write the scripts that perform these tasks. This project could lead to long term income as changes to the database are needed.

This is my specific requirement -

A configuration file in Q specifies schema details, partition and segment details (such as partitioned by date, segment set to 10 dates) and other relevant parameters.

1. Scripts that load historical data csv files and create a segmented, partitioned and splayed db based on the specification.

2. Scripts that run daily and read daily csv files, add new data to db. New segments/partitions are created as the data grows as per pre-configured limits in config.

3. Admin scripts to manage starting, stopping the server, reloading databases, and do error reporting and consistency checks.

Please let me know if you will be able to do these tasks. If I like the work, I will have more work in future to create more scripts, make enhancements, address issues and migrate schema for additional income.

Anyone with KDB/Q expertise please feel free to contact me.

Skills: Data Processing

See more: kdb create partitioned, kdb database schema, kdb create historical database csv files, kdb historical database, load historical data kdb, specification requirement, schema update, make enhancements, partition date kdb, kdb database, kdb, file partition, database building 2, create a flat, build a server, flat expert, partitions, flat admin, csv files processing, add migrate, stopping, project database error, database daily contact, lead requirement, database historical

About the Employer:
( 0 reviews ) United States

Project ID: #2542383

3 freelancers are bidding on average $333 for this job


Dear I have just seen your Job posting and upon reading thoroughly, I felt strongly that I would be the most qualified contractor for your project. I have vast experience in IT/ Data Entry/ Web Research/Admin/SEO/ Co More

$500 USD in 30 days
(3 Reviews)

Can do the work. Please read PM.

$250 USD in 30 days
(1 Review)

To Whom So Ever It May Concern - SGS Infotech is one of the best Administrative Service Provider Company from India interested in your posted project in freelancer. Best Regards, SGS Info

$250 USD in 7 days
(0 Reviews)