2016 Fuji Norcom Straight 2.1 Stem issue

I just bought a Fuji Norcom Straight 2.1 and tried to lower stem so that it sits flush with top tube. I removed the spacers but now the steering tube is to tall to put the cap back on. Any advice is appreciated. Thanks.