I want a shell script (compatible for linux/mac OSX) that runs two different files X number of times, and performs a statistical analysis to see if one script runs faster than the other in a statically significant manner.
E.g. I normally run "time ./script1 input.in" and "time .script2 input.in", run both these commands approximately 10 times, then use the mean running time and variance to perform a t-test to see if one test runs faster than the other.
The file should take arguments: filename1, filename2, file1 input, file2 input, Number of times to run.
This should be a small project and not take very long.
Additional Project Description:
05/20/2013 at 17:19 EST
Very simple statistical analysis, just a quick test with confidence interval 90% to see if one script is better than the other.