You should! Starting at walk of course. They learn very quickly that dropping your stirrups means halt. Mine is very very lazy so it suited him just fine!
The one thing I can't do any more is stirrupless work because if I drop my stirrups he stops. I have to ride with stirrups, or bareback, or fight with him because he thinks he's supposed to be standing still.
I have absolutely no interest in letting angry bees loose - I would get stung too!