Upload large zip or csv files into mysql on local computer for further treatment in c#

IN PROGRESS
Bids
11
Avg Bid (USD)
$209
Project Budget (USD)
$30 - $250

Project Description:
I want a program in C# / MySQL, that would be able to:

STEP1
upload about 50 zip or CSV files. These files contain historical financial data and are very large for a total size of about 1.2GB zipped. I can send you a file example if you want.

1/ import files from a local computer. The files are either in ZIP or csv (a file example can be provided if necessary).
Table format (a table example can be provided if necessary).
orig_id bigint (20,0) not null primary key
id_minute bigint (20,0) not null
desc varchar(20) not null
datetime varchar(25) null
v1 decimal(10,5) null
v2 decimal(10,5) null

2/ sort data by datetime ascending
3/ remove any duplicate. duplicate if datetime & v1 & v2 in above/below records are equal
4/ add orig_id to every record
5/ group by minute (beginning & end of minute).
a) Please also allow possibility to only group by end of minute (or beginning of minute) instead of having beginning & end of minute values
b) Please also allow possibility to group by a variable number of minutes
6/ ad id_minute to every record by minute
7/ merge new data with historical data
8/ since process is very long, provide ability to text/email when each process is finished

The reason you will need to process file by file instead of importing all files together and doing the process only once is because the file size would be large to freeze the computer.

STEP2
Once the 50 files are uploaded into mysql, design process to upload a monthly file to upload and do the same steps to then append to the past data.


Thank you

Skills required:
C# Programming, Database Administration, MySQL, Software Architecture, Software Testing
Additional Files: EURUSD-2010-09.zip
About the employer:
Verified
Public Clarification Board
Bids are hidden by the project creator. Log in as the employer to view bids or to bid on this project.
You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.


Hire barundebnath
$ 250
in 7 days
$ 240
in 3 days
Hire Rahul2012
$ 150
in 2 days
$ 250
in 1 days
Hire techwelf
$ 241
in 12 days
$ 150
in 7 days
$ 250
in 7 days
Hire szsolutionsvw
$ 220
in 10 days
$ 200
in 15 days
Hire SheldonCoop
$ 150
in 3 days