a 545 motor like a 540 but with 5 poles (should make it low drain)
Oh no, my son! Don't be fooled by that old tale. I have several 5-pole x 35mm dia motors that would pull your limbs off on 6v, and a 3-pole one that would have trouble with pulling the skin off a rice pudding on the same battery.
It's the thickness and number of the windings that dictate the speed and current drain, not just the number of poles.
Having said that, I'm with Martin; your motor is probably overloaded.
FLJ