I'm working with large csv files up to 50GB in size. Typically one file is around 30GB while the one that will be merged onto it is just about 100 MB. The code I'm currently using will take about 1 hour to parse and merge two files. If we can reduce the time this takes by writing new code that will be great.
23 freelancers are bidding on average $175 for this job
Hello I am a Python and c++ expert. I have worked on a project of sorting very large files, so I am capable of doing yours. Let me know please about the criteria of merging. Feel free to send a message.