Lack of hip rotation causes you to plow through the water rather than swimming on you sides.

When you say you don't much kicking. You mean kicking drills? Or kicking in general? A 6 beat kick will make you faster and helps with rotation