I just get it all in one good swipe, instead of going over and over several times, so I worry less about the hair falling inside the ear. I have put cotton ear balls in too, to keep the small ones from falling through the canal, except you can't always get the botton of the ear, you get a chunk of cotton instead. But the clippers I have, have little plastic attachments so you can regulate how much comes off, and I just use the medium length ones for ears. I leave plenty of hair in there, I just clean up everything fluffy and that sticks out. Some people like it all gone, but I prefer to leave some in there, just shorter, for protection purposes.
These are the ones I have-Wahl Touch Up Trimmer in Clippers at Schneider Saddlery