Memory optimization of a C shell program

Hello developers,

My program is a shell program, working under most types of Unix. I use Mac OS X.

It's reading data from text files. After reading files, the textkorpus is completely in memory.

With special commands I can navigate in the text data.

This works fine.

Only thing: My data structures consume too much memory. A total of 756kB of text data converts into more than 12 MB in memory!

This limits my program to read large amount of text files.

I'm using a Hashtable and an AVL tree. And I store information redundantly. But even though the prog should not consume so much memory.

This is why I need help. Somebody that knows how to use gdb or similar tools to track down where the memory consumption really happens and fix that.

Perhaps a compressed form of storing the strings could be thought of. Perhaps a different hashtable is needed. I don't know.

I provide the source as a zip file. Within there is a directory "amazon" that contains the 756kB text data.

Additional there is a [url removed, login to view] describing how to start the prog.

If it's possible to bring the memory consumption down to let's say 4 MB or lower I would pay an extra bonus of $500.

Thank you guys.

All the best


Skills: C Programming, Software Architecture, UNIX

See more: why use data structures, why data structures, where to start programming, use of data structures, types of tree structures, types of tree data structures, types of programming, types of data structures in c, types of data structures, types data structures, tree programming, tree in data structures, tree data structures in c, tree data structures, t$c, strings in c programming, programming types, programming tree, programming tools, programming structures, programming data types, programming data structures in c, programming and data structures, os x programming, mac tools

About the Employer:
( 11 reviews ) Zürich, Switzerland

Project ID: #1270609

Awarded to:


I'm an expert in gdb and valgrind. I would like to handle your project.

$299 USD in 2 days
(7 Reviews)

11 freelancers are bidding on average $379 for this job


I look forward to take up the project

$425 USD in 12 days
(74 Reviews)

Please check PMB.

$250 USD in 3 days
(43 Reviews)

Hi, I am confident to handle your project. Please check your inbox for details. Thank you.

$250 USD in 3 days
(57 Reviews)

Sounds interesting!

$400 USD in 5 days
(8 Reviews)

Details in PMB

$500 USD in 3 days
(21 Reviews)

Hi, please check PMB. Thanks.

$300 USD in 7 days
(20 Reviews)

Please see the details in my private message.

$500 USD in 10 days
(2 Reviews)

Hello! I have already downloaded your sources. I will see if I can get it lower than 4 MB as you specified and send it back to you for verifications.

$500 USD in 2 days
(7 Reviews)

I have good experience in C under Linux.

$500 USD in 7 days
(2 Reviews)

I'm interested with this project. I'll try to make it less than 4mb and send it back to you for testing.

$250 USD in 3 days
(3 Reviews)