Login required to started new threads

Login required to post replies

Prev Next
Rules for the Reporting of Aero Tests
Quote | Reply
Okay everyone (okay, especially the aero nerds), this is your chance to, perhaps, shape the industry a bit. If you had your way, how would you like to see aero tests conducted and reported?
  1. What protocols would you like to see?
  2. In what format would you like the results reported?
  3. Whether you're a consumer, or represent a manufacturer, what would level the playing field so everyone is playing by the same rules?
Here's the deal...we have an idea. ERO is uniquely positioned to access both velodrome testing (probably didn't need to be said), and the San Diego Wind Tunnel regularly, and offer manufacturers of all sizes the chance to test at substantially lowered costs. The testing will be completely independent (you might say, oh I don't know, "ERO Neutral" ;-) ). The results will belong to the manufacturers to do with what they want, but when they are made public, you'll be sure they're accurate and trustworthy.


What would you like to see?

Jim Manton / ERO Sports
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
Jim@EROsports wrote:
Okay everyone (okay, especially the aero nerds), this is your chance to, perhaps, shape the industry a bit. If you had your way, how would you like to see aero tests conducted and reported?
  1. What protocols would you like to see?
  2. In what format would you like the results reported?
  3. Whether you're a consumer, or represent a manufacturer, what would level the playing field so everyone is playing by the same rules?
Here's the deal...we have an idea. ERO is uniquely positioned to access both velodrome testing (probably didn't need to be said), and the San Diego Wind Tunnel regularly, and offer manufacturers of all sizes the chance to test at substantially lowered costs. The testing will be completely independent (you might say, oh I don't know, "ERO Neutral" ;-) ). The results will belong to the manufacturers to do with what they want, but when they are made public, you'll be sure they're accurate and trustworthy.


What would you like to see?


standardization of mannequin position when tunnel testing. Requiring mannequin when rider interaction is significant; this would apply to handlebars, frames, and helmets.
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
For testing bikes/equipment, ideally test same rider, same position / setup in both places, then have a look at results plus the "average"

For wheels... we want to see the fastest tire on THAT wheel AND the competition. No more wide tires on wide rims vs. wide tires on H3's.

When testing bike vs. bike (no rider or rider) let's have the test of bikes of the closest sizes, not the actual "store box" sizes. Manufacturer sizes should be gone.

My Blog - http://leegoocrap.blogspot.com
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
Jim@EROsports wrote:
The results will belong to the manufacturers to do with what they want, but when they are made public, you'll be sure they're accurate and trustworthy.

As a consumer, what I prefer are shoot-off style events of commercially available products, like TomA did with Specialized. I'm not sure how that jibes with what you're doing, which sounds like providing more of an R&D service to manufacturers.

And I like shoot-off style events because I have greater confidence of consistency in protocol, calibration, etc. It's nice, if say, Zipp's wheel scores a CdA of 0.00001 and is the most aero wheel ever and kicks the shit out of a Mavic Open Pro. I still like to see a CdA or grams-drag plot overlaid with several other *good* wheels tested at the same time in the same conditions by the same people with the same protocol, same calibration parameters, etc. (and same rider(s) if rider is present).

Not sure how you're going to get all those manufacturers to agree to release their data so such a plot can be released. If all the losers take their ball and go home, we may not end up with much more than we have now.

But TomA's blog is a good start:

1) CdA estimates - over yaw/beta if wind tunnel
2) Error margins reported
3) High resolution pictures of equipment *as tested* from all angles. Detailed report on how different frames were set up to be comparable, e.g. matching contact points?
4) Repeated re-testing of control throughout
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
Following up on my last post...this is what I'd like!

You offer a reduced-cost service to manufacturers, but have an explicit "shoot-off" surcharge as part of that service.

Whenever the shoot-off fund gets big enough, you schedule a shoot-off day. Manufacturers are ejected from the building. You bring in someone like TomA as a neutral observer, and get loaned equipment from LBSs or riders. Then shoot everything off. Manufacturers get no say in anything.
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
That's a huge question. I'll have to have a think about it.
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
Let me clarify before this gets off track. This is not testing specifically for consumers; we have another avenue for that. We're presenting an opportunity for manufacturers to have access to reduced cost aero testing for their products. The testing will be completely independent. The results will be theirs to keep and use as they like. Whether or not they ever release them to the public is up to them. Much of the testing is simply R&D, not finished products, and will never be seen by the general public.

What we're looking to do is not only provide this access, but also to standardize test protocols. Establish a set of rules everyone will be expected to live by whether they test with us or not. For the consumer, this helps you trust the data when it is released, but it isn't otherwise for you.

Jim Manton / ERO Sports
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
So you're essentially trying to standardise the criteria against which equipment and positions are judged. This has wider implications than simply having comparable data for different manufacturers or testers (should they choose to divulge it) but rather, if adopted, it would direct much of the future development of the sport.
If a standard becomes accepted then companies will start designing products to maximise performance against those specific criteria. That can be positive or negative depending on how well those criteria have been selected and defined.

If done badly this could stifle innovation or might just not be widely adopted, but if you get it right and if it becomes accepted industry standard it could act to curb pointless "gimmick" innovation and instead get R&D focused on legitimate avenues of improvement.

I think you need to take a structured approach to this. Set out exactly what you aim to achieve in terms of future use and transferability of data. For example, there are a number of parameters that may be hard to replicate form one day to the next or one test facility to another such as wind tunnel correction factors, air temperature, pressure & humidity, any use of live subjects will not be adequately repeatable for equipment tests. Live subjects should only be used when testing the rider themselves....
Last edited by: Ai_1: May 25, 16 8:50
Quote Reply
Re: Rules for the Reporting of Aero Tests [Ai_1] [ In reply to ]
Quote | Reply
Yes, this is the feedback I want. We have a lot of this covered already, and certainly understand and respect the implications, but we're looking for what we've missed. Excellent...thank you.

Jim Manton / ERO Sports
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
How about a standard control bike? No matter who/what/where you are testing - you run the same bike first. That way you always have the same thing to compare too.

**Just spitballing here - no idea if this would be practical or actually help.
Quote Reply
Re: Rules for the Reporting of Aero Tests [trail] [ In reply to ]
Quote | Reply
http://www.tririg.com/...omega_whitepaper.pdf

trail wrote:
TomA's blog is a good start:

1) CdA estimates - over yaw/beta if wind tunnel

Check.

trail wrote:
2) Error margins reported

Check.

trail wrote:
3) High resolution pictures of equipment *as tested* from all angles.

Oh, crap. Missed out on that one. The example pic I provided had pretty crappy resolution, and was only from one angle.

trail wrote:
4) Repeated re-testing of control throughout

Check.
Last edited by: Andrew Coggan: May 26, 16 8:00
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
For wind tunnels - take symmetric yaw sweeps out to 15 degrees in 5 degree increments and report the data. None of this weighted avg being the only reported value goofiness. If you want to include a weighted average in the reporting data you must include the formula to calculate the value.

A universal control bike would be a god send. I.e. ERO owns a bike that everyone tests against that is lent out for free to whatever testing group wants to publicly publish the data.
Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
I had talked to A2 wind tunnel about this, and offering a "certified stamp" or something like that. I didn't want to be the guy who thought tests could be manipulated, but the last time I was there I had asked if they ever checked over the results people posted compared to what the wind tunnel reported. It'd be pretty easy to manipulate the raw data sheet and lie about numbers. I'd like to think we are all above that, but it's a possibility it could happen. We've all seen things on this forum where business owners fudge the truth here and there.

I'd also like to see the standard for wheels be without the tare of the stands removed. Running the stands by themselves and then subtracting those numbers isn't the most accurate method for reporting data (told to me by A2 tunnel). The stands react differently to a 30mm wheel vs. a full disc. A full disc wheel at high yaw could completely shelter one of the stands. . .yet when you subtract the value of both stands you are artificially making the numbers lower.

__________________________________________________________________________
http://www.boydcycling.com Handcrafted Revolution
Quote Reply
Re: Rules for the Reporting of Aero Tests [pyrahna] [ In reply to ]
Quote | Reply
pyrahna wrote:
For wind tunnels - take symmetric yaw sweeps out to 15 degrees in 5 degree increments and report the data. None of this weighted avg being the only reported value goofiness. If you want to include a weighted average in the reporting data you must include the formula to calculate the value.

A universal control bike would be a god send. I.e. ERO owns a bike that everyone tests against that is lent out for free to whatever testing group wants to publicly publish the data.

I agree some kinda of universal control group that is what everything else is tested against.

2024: Bevoman, Galveston, Alcatraz, Marble Falls, Santa Cruz
Quote Reply
Re: Rules for the Reporting of Aero Tests [coachboyd] [ In reply to ]
Quote | Reply
coachboyd wrote:
I had talked to A2 wind tunnel about this, and offering a "certified stamp" or something like that. I didn't want to be the guy who thought tests could be manipulated, but the last time I was there I had asked if they ever checked over the results people posted compared to what the wind tunnel reported. It'd be pretty easy to manipulate the raw data sheet and lie about numbers. I'd like to think we are all above that, but it's a possibility it could happen. We've all seen things on this forum where business owners fudge the truth here and there.

I'd also like to see the standard for wheels be without the tare of the stands removed. Running the stands by themselves and then subtracting those numbers isn't the most accurate method for reporting data (told to me by A2 tunnel). The stands react differently to a 30mm wheel vs. a full disc. A full disc wheel at high yaw could completely shelter one of the stands. . .yet when you subtract the value of both stands you are artificially making the numbers lower.

The "scrubbing" of numbers is quite common. It's one issue we aim to "scrub" away.

Interesting thoughts on wheels. I'll talk to the guys at the San Diego Tunnel about that.

Jim Manton / ERO Sports
Quote Reply
Re: Rules for the Reporting of Aero Tests [BBLOEHR] [ In reply to ]
Quote | Reply
BBLOEHR wrote:
pyrahna wrote:
For wind tunnels - take symmetric yaw sweeps out to 15 degrees in 5 degree increments and report the data. None of this weighted avg being the only reported value goofiness. If you want to include a weighted average in the reporting data you must include the formula to calculate the value.

A universal control bike would be a god send. I.e. ERO owns a bike that everyone tests against that is lent out for free to whatever testing group wants to publicly publish the data.


I agree some kinda of universal control group that is what everything else is tested against.

Agree with a lot of this. The control bike could be a universally-accepted spec. (round steel tubing, a defined stem/bar, 32-spoke Open Pros with Conti 4000s II 23c tires, etc.).

For the reporting, show all the yaw data; but also show the time savings for weighted yaw at 50, 40, and 30kph (the yaw weighting will be different for each, and the %s need to be an agreed standard). No tris are ridden at 50kph, and lots of IM bike legs are done at 30kph. None of the quoting watts saved at 50kph and having people thinking that's watt saving they will actually see.

ECMGN Therapy Silicon Valley:
Depression, Neurocognitive problems, Dementias (Testing and Evaluation), Trauma and PTSD, Traumatic Brain Injury (TBI)
Quote Reply
Re: Rules for the Reporting of Aero Tests [trail] [ In reply to ]
Quote | Reply
it's helpful to also make sure the balance being used to generate data is not biased.

=================
Kraig Willett
http://www.biketechreview.com - check out our reduced report pricing
=================
Quote Reply
Re: Rules for the Reporting of Aero Tests [Titanflexr] [ In reply to ]
Quote | Reply
This is why time savings over 40km or CdA savings would be preferable. Reporting drag savings in units of power is annoying. Results need to be reported in as non-dimensional a way as possible.

Also, applying weighting schemes probably adds value to the results, but complicates the issue of explaining to an individual the gains he may or may not realize in comparison with the scheme. I like the weighted average delta--that's something I use in testing cars, but the individual deltas from each yaw angle shouldn't disappear altogether.

__________________________

I tweet!

Quote Reply
Re: Rules for the Reporting of Aero Tests [pyrahna] [ In reply to ]
Quote | Reply
pyrahna wrote:
For wind tunnels - take symmetric yaw sweeps out to 15 degrees in 5 degree increments .....
5 degree increments are a very coarse resolution if you want to plot a really useful polar.
You'll only end up with 7 data points and would likely miss many significant interference issues or stall points. I realise more points means more tunnel time or fewer test configurations but what's a reasonable compromise? This seems on the low side to me.
Quote Reply
Re: Rules for the Reporting of Aero Tests [Ai_1] [ In reply to ]
Quote | Reply
I'm open to variations on this theme, but if you set the bar too high for points taken people will avoid using the standard because it is too expensive to meet the expectations.
Quote Reply
Re: Rules for the Reporting of Aero Tests [ZackCapets] [ In reply to ]
Quote | Reply
The important thing is to get the base data in as universal a formula as possible. That way the marketing people can come up with what ever numbers they want to present and consumers can either take the data as presented to them or take the base information and calculate out whatever best metric suits them.

CdA (m^2) at different yaw angles is the most fundamental unit of drag. Everything can be accurately and repeatably calculated from this set of data.
Quote Reply
Re: Rules for the Reporting of Aero Tests [pyrahna] [ In reply to ]
Quote | Reply
Agreed, although I think you may be putting too much faith in the marketing people to truthfully represent the results.

Playing devil's advocate here:

Ultimately, some bikes and some wheels will be faster than others. Holding every manufacturer's hand to the same flame benefits consumers but not the manufacturers, because the smart triathlete would buy the fastest (least draggy) bike that fits and is in their price range. Wheels are an even simpler decision than the bike (aside from handling and rider speed effects on yaw).

Maybe this is the price you as the manufacturer pay for discounted tunnel time?

__________________________

I tweet!

Quote Reply
Re: Rules for the Reporting of Aero Tests [ZackCapets] [ In reply to ]
Quote | Reply
You seem to be misinterpreting my request. I am putting NO faith in the marketer's message. I want 'fundamental' data (CdA yaw sweep) that I can base my own decisions on and make my own metric calculations on. The marketers can simplify the data in any way they seem fit to come up with a single number that they can show as 'faster' and I will gladly ignore it as long as I have the fundamental data to make decisions on.
Quote Reply
Re: Rules for the Reporting of Aero Tests [pyrahna] [ In reply to ]
Quote | Reply
Ah okay. Yeah that makes sense.

__________________________

I tweet!

Quote Reply
Re: Rules for the Reporting of Aero Tests [Jim@EROsports] [ In reply to ]
Quote | Reply
Its an interesting idea.

I would like all the tests to include both velodrome and tunnel testing to begin to set up correlation numbers.

Having a standard Mannequin would be very helpful.

The "Standard Bike" as a reference would be great but to start I think a Cervelo P5 should be included as well simply because so many bike numbers have been compared to that bike. It would also provide a (range) reference to those that have followed the bike vs P5 comparisons and begin to set up the "Standard Bikes'" numbers.

Wheels are a bit of an issue in that forks are designed to work with specific wheel profiles. If you use a "Zipp" type standard that may hurt the manufacturer that designs around a different profile. So - I would prefer that you use the wheel that is specified on the bike "as purchased". That poses a problem for those manufacturers that sell a nice bike with "training" wheels.

If you don't use a rider or simulated rider; I would suggest all the tests with the [seats removed] as that is in-many-instances a throw away item.

I would like to see left and right side sweeps at 2.5 degree increments from 0-15 as standard.

One additional issue is what to test - "bike as offered in standard purchase components vs bike as purchased and then new (saddle, wheels, tires, hydration, computer and mount etc..).

Are we testing to determine fastest ultimate bike with rider or to compare purchase value for consumers? Maybe two different protocols.

Dan Kennison

facebook: @triPremierBike
http://www.PremierBike.com
http://www.PositionOneSports.com
Last edited by: dkennison: May 26, 16 7:00
Quote Reply

Prev Next