I need to run data analysis on a big data set that is uploaded to an FTP server once a week.
The data consists of several data tables.
I need to set up a server or software that automatically grabs the data fresh every week, does some automated cleaning and linking, and then allows me to create customer queries and reports.
Give me access to the data and the queries in something like Toad or HeidiSQL.
Create a web-based GUI where I can write and run queries and see data output,charts, graphs, etc.
There will probably be a few steps to this project.
1) Automate downloading FTP data to new server
2) Automate cleaning data
3) Create place to run custom queries and reports
4) Help automate some of the reports/queries that I find useful and want to run every week