Hi! I have a large Excel dataset (>50000 rows, >300 columns) that I parse through to find rows that meet specific conditions (eg. find all rows where column N >5 and column Z <1.2). Based on the results, I then set up models to apply to real-time data in order to make predictive decisions (investments). I'm familiar with VBA and it's easy to set up a parser to search through the data to create the models. But it's very time consuming, especially as the dataset has grown. I would like to get some help either making this faster or transferring this dataset to a more efficient database. This project is for providing an update to my Excel file that shows improvements in efficiency or an alternative database with example parser code (eg. R, Python, etc).
32 freelancers are bidding on average $170 for this job
Better to shift data to SQL server or MYSQL database it will perform this execution within milliseconds, i can convert all your excel data to that new database system and parsing the condition
Hello, I can make a Python script which will process data way faster. Or I can put all the data into a MySQL database. Either way, it will be faster. Inbox me so I can help. Thanks