Current set up is -17 100mm stem with 20mm spacer. Would I be better off with a -6 100mm stem and no spacer? Is there a difference? I checked and looked like it will put my bars in same position.

I can knock off prob 100grams with -6 stem. So I don't see any reason not to go this route.