I believe (best to confirm with Notio), that there is a "window" in which the compute their rolling CDA and this is configurable (by default 60seconds). "Lap CDA" is computed from when you press the lap key. So you can be sure there is no turn around data in it. This may have changed, check with them.
The challenge with either of those methods is if you have bad data (altitude or other) during the interval measured. If you use an out and back with net elevation=0 you can cancel out elevation error. But you'll get a number for the entire lap, not rolling value(s).
If you want an accurate rolling CDA you need accurate altitude. If you are not seeing accurate altitude, that is probably your problem.
Eliminating errors by restricting protocol is ok. Better is to identify error, best to correct it with another sensor.
It's not just to get a better measure for the lap, but for a whole bunch of other reasons. If you have good altitude, you can compute reasonable estimates of intermediary data and you can do things like :
- Calculate standard deviation to get confidence in your individual test.
- Separate CDA/CRR at various speeds that change significantly with altitude climbs and descents.
- You can override/correct one sensor with another (baro vs acceleromter vs gyro vs....)
- You can measure the impact of position changes and yes, people move during the test
- The better the data, the shorter the rolling window, the closer you can get to "instantaneous". Different opinions on how short a window is good enough.
- You can start differentiating impact of yaw and not have to try and eliminate it like you do
- ...there is a long list of things you can do better. And no, not all devices do all this....
When you do all these things, you don't force a protocol, you can race with it, you don't need to ride at 27mph to reduce yaw....all kinds of good things.
IMO This is where the technology needs to get.
The more you treat it as an aggregated out and back with constant speed, assuming wind is constant........the lesser value. At one extreme you have lots of constraints and get "fuzzy numbers", and at the other extreme : precision, accuracy in all kinds of conditions. I believe this is what should differentiate the $80 solution and the $3000 solution.
I think you have discovered that altitude is as harder to measure than wind . You have discovered VE is the best way to diagnose and work around some of the challenges of altitude. Having seen altitude challenges in several products, it's clear it's a tough nut to crack. I hope all products export to GC/Aerolab to do diagnosis.
An aerometer is like a scale. You get on it and it says 75kg. Is that really, 74 or 76 ? You don't know. But if you get on and it's 74, then 30seconds later 77, then 30 seconds later 75...your confidence is hurt.
Outdoor/road testing is noisy but again, what will differentiate the various devices is the ability to detect and correct that noise and use it it a variety of condition.
I found this article interesting
https://www.rouleur.cc/...U3XH5fJH01O9_B7iWgxc if a manufacturer needs a closed road to do tests, if you need a flat surface, if an out and back is mandatory, then the manufacturer needs to continue refining their solution to get from good to great.