I want a shell script (compatible for linux/mac OSX) that runs two different files X number of times, and performs a statistical analysis to see if one script runs faster than the other in a statically significant manner.
E.g. I normally run "time ./script1 [url removed, login to view]" and "time .script2 [url removed, login to view]", run both these commands approximately 10 times, then use the mean running time and variance to perform a t-test to see if one test runs faster than the other.
The file should take arguments: filename1, filename2, file1 input, file2 input, Number of times to run.
This should be a small project and not take very long.
16 freelancers are bidding on average $66 for this job
I got your point. The automatic script can be written in bash script, and the t-test can be done through command line statistic tool (PSPP is free and CLI-friendly). This is a challenging task for me!