Tire choice and pressure is absolutely crucial to any wheel testing and, for that reason, it’s practically impossible to conduct a test like this properly. If you try to make the testing “fair” by using the same tire and pressure for each wheel, you’ve likely produced near meaningless data. There are simply too many variables; it would take weeks to test all the different combinations. Then, of course, you’ll need to repeat those results to give them value. Fun!
I couldn’t agree more, and it’s the exact reason we’ve never done a FLO vs. Them study.
I have to say that I find it funny how the manufacturers are always made out to be the villains in these studies. As manufacturers, we certainly do not know everything, but I can tell you as a collective group, we have learned a lot about testing products. Honestly, most of us work together to help ensure the data we are producing is as good as possible. Some of the best advice we have ever received has come from our biggest competitors.
I’m not saying that all brands are 100% transparent and honest with their marketing, but I think most of our customers are smart enough to spot the fakers when they see them.
I think it’s important for people to understand how the smallest changes in a wind tunnel can result in massive changes in drag. In most cases, these changes are so small or non-obvious that the people conducting the tests have no idea they are introducing error. Your protocol can render tens of thousands of dollars worth of wind tunnel time completely useless.
Independent and crowdsourced testing is great, but people need to pay close attention to their protocols and heaven forbid, ask the manufacturers for advice. Take the following as an example. There have been several crowd-sourced studies on this forum. One, in particular, added hundreds of grams of drag worth of error to their results in how they set up their tires. Yes, hundreds of grams in just the tires. Conclusion, the results are useless.
We own a $2,000 pressure sensor that we use for all of our studies. It’s accurate to +/- 0.1 psi or better. Why? Because tire pressure is critically important. Had the people conducting the above study called and asked for advice, we would have gladly loaned them the pressure sensor, and in a single conversation eliminated hundreds of grams of error. Honestly, the more good data, the better.
A while back we contacted all of the brightest minds in our industry to create a Collective Testing Protocol (CTP) that all manufacturers could adhere to. The idea was to develop a standard protocol—available to the public—that eliminated as much error as possible. Wind tunnels could then become certified to conduct CTP studies, and your results would be stamped with a CTP logo by an independent 3rd party. We had 100% buy-in when we presented the idea, but when the actual work had to be done, most of the people backed out. I still have the wheel protocol somewhere.
Anyway, my moment on the soapbox is over. We’ll be discussing all of this stuff in future podcasts simply because we think it’s important to share what we’ve learned with our audience.