I will just make this general comment. I feel this thread have somewhat derailed and the testing that was performed taking out of context. The athletes, me included, are not professionals. We all have day jobs and triathlon is our hobby. We had to pay to do the testing. No one had a sponsor that paid for testing, hotel, airfare, car rental, taxi etc. Most of us had to burn a few days of vacation in order to attend. In this thread we are not trying to sell you anything. We know there is a lot of interest around aero testing in general and we decided we would be willing to share our experience. The way you try to hold us accountable for the numbers and the repeatability is unrealistic. On average we had about 12 runs each and a ton of stuff we wanted to test. I did 10 runs and of those 10 runs two were baseline runs. Without looking up the numbers I can’t give you the exact delta between the two runs but they were very close.
If I had time and money I would do many repeat runs. I happen to have a good statistics background and I use statistics daily for work so I understand what you guys are talking about. I understand that the numbers reported are single data points. I simply cannot afford to do 30 runs just to determine if 15mm of less stack is better or worse than my base line. I did one run and it showed much worse numbers so I abandoned it. If I didn’t I would have used up all my 10 runs on that one change and still not had a sample size that would be large enough to show a statistically significant difference. What some of you are asking of us is simply not realistic.
I have in the past bitched about equipment manufacturers not showing their data. We get a graph showing how much better wheel A performs compared to wheel B. We never get to see if the difference between wheel A and B is statistically significant. As a consumer I feel they should show give us that information. If not, that sexy graph they give us in my mind is not worth much as it can be very misleading. The manufacturers are trying to sell you something. The weekend warriors hat did the testing are not trying to sell you something. Trying to hold Heath accountable for a big drop of his drag number is not realistic. Heath like the rest of us had a limited number of runs. The huge drop for him came late in the testing session. There was not time to repeat the run 15-20 times nor was that in anyone’s budget.
The demand for repeat runs and statistically significant data from us is not realistic. If anything you should be adamant about getting that from the equipment manufactures. Not from a bunch of age groupers doing testing spending their own time and money.
http://www.frostyjunction.com/
https://twitter.com/FrostyJunction