TCR owners : high speed wobble?

"all the spacers on between fork and stem, I think that gives the bike more flex. "

That wouldn’t be my problem. I’m quite low in the front. It doesn’t happen all the time, just sometimes, and like I said is corrected by unweighting my butt and touching the top tube with my knees. From what I’m gathering here, could be because I’m gripping the bars too tight when descending.