Grill wrote:
Exactly, which makes the entire test pointless for anything other than a vanity project. Either you go frame-only (which is just a dick-measuring contest for those who based frame design on similar protocol), or you put a rider on and find the bike that works best for their position.
I wouldn't say pointless. Personal testing is really, really time consuming (and money-consuming if a wind tunnel is used). Both bike setup, and the # of trials it takes. And when considering the possible combinations of dozens of good frames, wheels, bars, bottles, tires, and other things, it's a combinatorial explosion of permutations where a full lifetime of personal testing couldn't burn through. And all that time is time that could be spent doing other important things. Like training.
Having a rough ordinal list allows management of that explosion. Start at a reasonable good place. Avoid things that are unlikely to work well. For example, start at combinations that will likely get you to, say, 0.2 or better. Then do the personal testing to work down to 0.19 (or whatever)
You might miss some freak interaction where only you achieve some magical benefit. But you're likely to miss that freak interaction anyway. And, generally, there aren't many freak interactions. Fast frames are fast. Fast wheels are fast. I know you love to repeat your bit about finding super special things that only you know about. But that's not the general experience of people who've tested.
Edit: The value is in basically being able to call B.S. on B.S. and not waste time on things that are very unlikely to be worth your time.