Login required to started new threads

Login required to post replies

Prev Next
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Andrew Coggan] [ In reply to ]
Quote | Reply
Andrew Coggan wrote:
A model can said to be "broken" when it predicts something completely nonsensical, e.g., when W' balance goes negative.

That's not the case with the data above, as you are merely comparing the measured and predicted data.

I should also point out that 1) the two estimates of FTP (i.e., mFTP and 60 min power agree exactly), and 2) TTE isn't predicted with the same precision as the other model parameters - indeed, it can't be, due to the shallow slope if the power-duration relationship in that region (such that, e.g., even a 1 W difference in power translates into a much larger difference in duration). Recognizing that obvious fact (which I have pointed out ever since TTE started being reported), the difference between 45 and 60 min (which seems to be what caught your attention) is practically irrelevant.

IOW, you are making a mountain out of a molehill (just like Trev the Troll).

If you feed the WKO4 model a valid MMP60 data point and it spits out that TTE is 45min @ mFTP of 234w then your model (and determination method for TTE) is broken. The fact that the mFTP and MMP are equal is just luck and you know that is a very very very deceptive argument. If you know as much as you claim to do then you should be ashamed for saying that.

You might want to review the annotated graph below showing how poor the WKO4 model does at fitting the data. Why is there a 12w gap at the 60m when the MMP data from 40-60m is so flat? Model error. Sure if you feed it more data it will get better, but if the model can't get the 40-60minute domain correct after feeding it a good 60MMP data point then it has issues.

Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
Quote:
The fit is pretty poor at very short durations < 30s.
It's really hard to say if that's a problem with the model, the fit or the quality of the data there.

Almost certainly a combination.

(1) I have not conscientiously attempted this duration over the last 3 mths.
(2) I am weak over this duration (compared to myself at other durations and my peers).
(3) I think my physiology that my strongest durations are 1-2.5 minutes combined with <30sec being my weakest makes it hard for models to fit even when I have datasets over multiple durations (like the last couple of years).
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Trev] [ In reply to ]
Quote | Reply
Trev wrote:
It is because just one or two watts make such a difference to the sustainable duration that I don't like imprecise, vague or approximate definitions or estimations of FTP.
You must hate Critical Power as well. And power at MLSS. Neither have a specific time associated.

It's just a physiological reality.

I looked at my last decent season. The dW/dt on my MMP curve was about 0.5W/min between 40 and 60 minutes.

That means a difference of just 5W creates an uncertainty in duration of 10 minutes.

Yet on any given day my power for a long TT or intervals can readily be more variable than 5W.

Natural biological variability.

Anyone who claims to be able to nail down an MMP duration with great precision is full of shit.

http://www.cyclecoach.com
http://www.aerocoach.com.au
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [AlexS] [ In reply to ]
Quote | Reply
AlexS wrote:
Natural biological variability.

Of course the goal here is to model maximal performance.

That means the athlete needs to be prepared for maximal performance. Whether that's nutrition, hydration, residual fatigue, mental alertness, motivation, readiness for environmental conditions. illness, injury etc.

As a coach I'm sure you know better than anyone that prep for competition isn't just about a taper. And that performance is impacted by lots of factors. And yes, at durations out at 45m-1hr the drop off is minimal in well trained adult athletes.

A maximal performance model has to assume you're gonna get these things right.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [rmba] [ In reply to ]
Quote | Reply
rmba wrote:
I thought you may be interested in this.

An approximately 3min effort (after puncture and quick change required an uphill chase of my group this morning) resulted in a reduction of CP and increase in W' along the lines of what I expected and, I think, gives a fair representation of where I am currently at. (with more to come to get back).

Note the heat map change also in the 2-3 min region.

This is very interesting.

So the only change in your MMP data was at-and-around the 3 minute mark? And this affects the slope of curve enough out at 30+ mins and beyond that it results in a 7W decrease in your predicted FTP?
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [awenborn] [ In reply to ]
Quote | Reply
awenborn wrote:
So the only change in your MMP data was at-and-around the 3 minute mark? And this affects the slope of curve enough out at 30+ mins and beyond that it results in a 7W decrease in your predicted FTP?


Yes that is the interesting point about the hyperbolic nature of power and duration as expressed in the CP model:

P(t) = CP + (W' / t)

At 3 mins W' still has a big influence on your maximal power. Once we get out past 12 minutes we're mostly aerobic. So the new increased value for P(180) suggested a higher value for W' which necessarily means that the contribution from CP is less.

Or in simpler terms - if you can put out big watts for short durations you've probably got more fast-twitch which means fewer slow twitch muscles than previously thought. I'm over simplifying /massively/, but hopefully you get the point*.

With the extended CP model we also consider fatigue at longer durations, but this is fraught with difficulty since hardly anyone rides maximally beyond 1hr, so the model fit tends to dip off early reflecting the paucity of maximal data at longer durations. For elite marathon runners maximal data goes out to 2hrs+ and is generally flat to this point.

Mark

* a study was done to look at the relationship between W' and thigh muscle size it found a meaningful correlation: https://www.ncbi.nlm.nih.gov/pubmed/12111284
Last edited by: liversedge: Nov 14, 17 7:55
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
liversedge wrote:
AlexS wrote:
Natural biological variability.


Of course the goal here is to model maximal performance.

That means the athlete needs to be prepared for maximal performance. Whether that's nutrition, hydration, residual fatigue, mental alertness, motivation, readiness for environmental conditions. illness, injury etc.

As a coach I'm sure you know better than anyone that prep for competition isn't just about a taper. And that performance is impacted by lots of factors. And yes, at durations out at 45m-1hr the drop off is minimal in well trained adult athletes.

A maximal performance model has to assume you're gonna get these things right.

My role as a coach is about helping people attain goals, more often than not when things are not perfect.

Despite best intentions, it's very rare that everything is perfect, indeed it's a fragile mindset that requires it to be that way. e.g. for hour records, I try to prepare the athlete to break it on an ordinary day, not just on their best day, while at the same time trying to help ensure they do indeed have one of their best days.

But even if everything is perfect, natural biological variability will still mean no model is perfectly predictive and the TTE for any given power will still have quite a range.

As I explained earlier to Trev, that 5W range on my MMP represents approximately 1.6% of my power at around FTP/CP level yet results in a 17% range in MMP.

Put another way, for me to be able to nail down an FTP/CP MMP to the nearest second as Trev would wish, it requires I be able to nail down an MMP value to the nearest 8 milliwatts. Every. Single. Day.

I think we can all agree that's a ridiculous and a physiologically implausible expectation.

But apart from being ridiculous, it's unnecessary, since the purpose of such models is to be useful by providing insight into one's underlying characteristics, actionable intelligence if you like, and not to be perfectly predictive of MMP.

If a model needs to rely on perfect inputs in order to be useful, then by and large it's not a particularly useful model since perfection is rare. All one needs to understand is what inputs are required to make a model useful for the intended purpose and over what domain the model is valid.

http://www.cyclecoach.com
http://www.aerocoach.com.au
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [awenborn] [ In reply to ]
Quote | Reply
Quote:
3 minute mark? And this affects the slope of curve enough out at 30+ mins and beyond that it results in a 7W decrease in your predicted FTP?
Quote:

10W actually.

What Mark said....

I knew the predicted W' was low and, much as I would like to believe that I could sustain the previously calculated CP currently, I know that I can't (give me a few more months, though!).

I also knew I had not really gone for it from 1-3 minutes durations. I think the curve will change a bit more (not as much as that) as I get back to what I know I can do for 1.5-2.5 minutes.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [AlexS] [ In reply to ]
Quote | Reply
AlexS wrote:
If a model needs to rely on perfect inputs in order to be useful, then by and large it's not a particularly useful model since perfection is rare.

On this I agree. Although it side-steps the issue at hand: WKO4 uses inappropriate data for model fitting.

Quote:
All one needs to understand is what inputs are required to make a model useful for the intended purpose and over what domain the model is valid.

Inputs for fitting a maximal power duration model are easy: maximal efforts.

Domain of validity for WKO4 model is unknown until it is has been fitted to appropriate data. If it is the Peronnet model* then it's reasonable to assume it covers 1s-1hr well.

Mark

* its components MAP(t) and AWC(t) have been shown to be *identical*
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
Knowing your FTP is useless if you don't know how long you can maintain it. A model which tells you that you can maintain FTP for 45 minutes when you can maintain it for over 60 minutes is not just useless but misleading.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Trev] [ In reply to ]
Quote | Reply
Trev wrote:
Knowing your FTP is useless if you don't know how long you can maintain it. A model which tells you that you can maintain FTP for 45 minutes when you can maintain it for over 60 minutes is not just useless but misleading.

There is no physiological measure or indicator that can nail down a TTE value at those longer durations with a high degree of certainty. To suggest otherwise is what would be misleading.

You clearly do not understand some basics about modelling human physiology. But more importantly, you most clearly do not understand the value of such models and their parameter estimates.

Here's a hint: it's not about predicting TTE with a high degree of certainty. If you think it is, then you are a fool.

http://www.cyclecoach.com
http://www.aerocoach.com.au
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
liversedge wrote:
* its components MAP(t) and AWC(t) have been shown to be *identical*
AFAIK, the WKO4 model has no MAP (or VO2max like) component/parameter, so I'm unclear as to how they could be deemed identical.

http://www.cyclecoach.com
http://www.aerocoach.com.au
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
If only you would shut up and stop misinforming people...alas, despite your repeated claims that you are going to do so, here you are in this thread, once again making patently false claims.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [rmba] [ In reply to ]
Quote | Reply
rmba wrote:
Quote:
The fit is pretty poor at very short durations < 30s.
It's really hard to say if that's a problem with the model, the fit or the quality of the data there.

Almost certainly a combination.

(1) I have not conscientiously attempted this duration over the last 3 mths.
(2) I am weak over this duration (compared to myself at other durations and my peers).
(3) I think my physiology that my strongest durations are 1-2.5 minutes combined with <30sec being my weakest makes it hard for models to fit even when I have datasets over multiple durations (like the last couple of years).

#3 isn't a significant factor.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Andrew Coggan] [ In reply to ]
Quote | Reply
Quote:
#3 isn't a significant factor.

Ok (I am no expert on modeling, it occurred to me that may be relevant but I have no problem to have been corrected).
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [lanierb] [ In reply to ]
Quote | Reply
lanierb wrote:
If I had to recommend one thing to Andy to make the model a little better, it would be to use the data on how often a given power target has been achieved.

1. How you collect/select data and how you model it are two different things.

2. While all sorts of data selection/filtering approaches are theoretically possible, you have to keep in mind A) bias (which is why an "envelope fit" is demonstrably inappropriate), and B) computational speed (which can be an issue even when fitting a model to just a couple hundred points using OLS).
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Pantelones] [ In reply to ]
Quote | Reply
Pantelones wrote:
Andrew Coggan wrote:
A model can said to be "broken" when it predicts something completely nonsensical, e.g., when W' balance goes negative.

That's not the case with the data above, as you are merely comparing the measured and predicted data.

I should also point out that 1) the two estimates of FTP (i.e., mFTP and 60 min power agree exactly), and 2) TTE isn't predicted with the same precision as the other model parameters - indeed, it can't be, due to the shallow slope if the power-duration relationship in that region (such that, e.g., even a 1 W difference in power translates into a much larger difference in duration). Recognizing that obvious fact (which I have pointed out ever since TTE started being reported), the difference between 45 and 60 min (which seems to be what caught your attention) is practically irrelevant.

IOW, you are making a mountain out of a molehill (just like Trev the Troll).

If you feed the WKO4 model a valid MMP60 data point and it spits out that TTE is 45min @ mFTP of 234w then your model (and determination method for TTE) is broken. The fact that the mFTP and MMP are equal is just luck and you know that is a very very very deceptive argument. If you know as much as you claim to do then you should be ashamed for saying that.

That's not luck, that's by intent/design.

To wit: both 60 min* MMP and mFTP provide estimates of maximal physiological steady-state. As such, you would expect close agreement between them, and that is what you find.

*~40 km power, actually

pantelones wrote:
You might want to review the annotated graph below showing how poor the WKO4 model does at fitting the data. Why is there a 12w gap at the 60m when the MMP data from 40-60m is so flat? Model error. Sure if you feed it more data it will get better, but if the model can't get the 40-60minute domain correct after feeding it a good 60MMP data point then it has issues.

You don't understand how OLS works, do you?
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [rmba] [ In reply to ]
Quote | Reply
rmba wrote:
I am no expert on modeling

That's okay, clearly not many people here are.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [AlexS] [ In reply to ]
Quote | Reply
AlexS wrote:
the WKO4 model has no MAP (or VO2max like) component/parameter, so I'm unclear as to how they could be deemed identical.

Indeed, I would have to say that has been my biggest revelation in all of this, i.e., the fact that VO2max doesn't leave a clearly discernable "fingerprint" on the exercise intensity-duration relationship.* Given the importance ascribed to VO2max in setting the upper limit of aerobic energy production and hence determining endurance exercise performance, you would think it would.

*Which is not to say that you can't predict VO2max from the same, and with considerable accuracy... just that you need to know what you are doing.
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Andrew Coggan] [ In reply to ]
Quote | Reply
Not being an expert, I would appreciate an explanation of why the WKO4 model doesn't seem to reflect what I have achieved on multiple occasions in the last 3mths from 5 to 60min-ish durations.

What sort of data is needed for the model to reflect what I am putting out? (ie can it be quantified by x number of efforts over y to z durations?). Does missing full on efforts between ~1-2.5 min affect it all?

I can post an updated curve since my 3ish min effort yesterday if needed (but won't get a chance for 24hrs or so).

(no criticism intended, just trying to understand).
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [awenborn] [ In reply to ]
Quote | Reply
awenborn wrote:
lanierb wrote:
paull wrote:
lanierb wrote:

Here are my thoughts: it seems unlikely that the WKO model is biased (low or high) on average across all athletes.


The OP's graph clearly shows the red line below the higher points of the yellow line. If the model was representing the athlete's best powers it would obviously be above the yellow line where an effort was not maximal and would touch the yellow line where an effort was maximal. Therefore it must be biased low.
If the yellow line has random noise in it, which it does, then the red line may be unbiased.

Do you understand what the yellow MMP line is showing? It's not "random noise", it's an example that demonstrates the fundamentally sub-maximal nature of any MMP dataset.

"The map is not the territory." - A. Korzybski
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [liversedge] [ In reply to ]
Quote | Reply
liversedge wrote:
lanierb wrote:
awenborn wrote:

Do you understand what the yellow MMP line is showing? It's not "random noise", it's an example that demonstrates the fundamentally sub-maximal nature of any MMP dataset.

You're assuming that the power meter data has no error in it. Imagine that some days your power meter reads high and some days it reads low, for random reasons (mostly temperature, and whether or not you remember to zero it at the start of your ride, but also because there can be data spikes and dropouts). The yellow line shows the upper envelope of the power data. Due to the random noise in the underlying data, this means that it's highly likely that the yellow line contains data points that you can't replicate on a day when your power meter is reading exactly correct all the time. Andy's argument is that if you fit the model to the peaks of the yellow line, which is what you and others are requesting, then because of the noise you get an overestimate of the true power duration curve for the athlete. Make sense? He fit the model to data for many athletes and that's what he found.

The corollary is being used: I don't trust the data so I'm going to use all of it.

See the error in that logic?

Except that isn't the logic being employed in using OLS to fit a model to mean MAXIMAL power data ( a.k.a., "the extremes of the extremes").
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [rmba] [ In reply to ]
Quote | Reply
Define what you mean by "doesn't reflect". Are you saying that the parameter estimates are too high or too low? If so, why do you believe that to be true, and how far off are they? (In a relative sense, i.e., as a percentage.)

(Regardless of your answers to the above questions, the answers spit out by WKO4 are the best you can expect based on your data, because the WKO4 model is the most accurate, precise, physiologically-correct, and statistically-valid model that has been developed. If it still isn't good enough for your purposes, all I can really say is "good luck.")

ETA: Although all points exert some influence on every parameter, some exert more on a particular parameter than others. It is possible to calculate the leverage that each exerts, but the answer varies somewhat depending on the exact shape of your curve. Thus, the most practical/pragmatic advise I can give is 1) look for durations at which your actual mean maximal power falls significantly below the fitted curve, then attempt to push those points up, and 2) use the fit statistics (i.e., parameter CVs and, to a lesser extent, SSE) and the guidelines I have provided to evaluate whether the fit is "good enough."
Last edited by: Andrew Coggan: Nov 14, 17 19:11
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Andrew Coggan] [ In reply to ]
Quote | Reply
Quote:
That's okay, clearly not many people here are.
As bright as you are I would think you could count to ten:)
Last edited by: ktm520: Nov 14, 17 20:02
Quote Reply
Re: WKO4's Power-Duration Curve Model Fundamentally Predisposed to Underestimate Power Output? [Andrew Coggan] [ In reply to ]
Quote | Reply
Quote:
Define what you mean by "doesn't reflect". Are you saying that the parameter estimates are too high or too low?

My mFTP has been reported as 244-246W for the last few months. In than time period, I have had the following powers on rides:

Aug 22: 1hr AP 252W, NP 255W (20min AP 262W)
Sep 17: 20min AP 265W, NP 265W
Sep 23: 20min AP 265W
Oct 8: 20min AP 258W
Oct 12: NP 271W
Oct 21: 1hr AP 248W, AP 249W (20min AP 255W)
Oct 26: NP 257W
Nov 9: NP 263W
Nov 10: 30min AP 256W, NP 258W

So there are numerous occasions where I have performed above the estimate of my mFTP. The 20min efforts in brackets after the 1hr efforts are to show the relatively small drop off so to add more meaning to the sub 1hr efforts shown. Where NP is noted without AP, it is because that was reflected by eg 30 sec to 1 min efforts with longer recovery (so AP over the duration is less relevant).

Quote:
the answers spit out by WKO4 are the best you can expect based on your data,
Aren't my examples above contrary to that? (please explain if this is not the case).

Quote:
If it still isn't good enough for your purpose
Please understand that I am a fan of WKO4 and find it very useful. I am in no way criticising you or the product.
I just don't understand what the model is showing based on these results.

Quote:
1) look for durations at which your actual mean maximal power falls significantly below the fitted curve, then attempt to push those points up,
May answer the question. (I have not yet tried my hardest at >1min to about 2.5min).

I will post the curve tomorrow.
Quote Reply

Prev Next