I way I get around this is to use a sleeveless tri top with a full length zipper. I don’t wear it in the swim - I just put it on after the swim, pre-loaded with my gels etc that I need. Just as quick to do this, than to wear it in the swim and then put gels etc in the pockets after the swim.