Yes! Casey actually likes the peel and the middle.
Funny story, we were waiting for the vet to get Casey's teeth filed, and I was eating a orange, sitting in my truck holding Casey, and Casey was bored, and kept on trying to slam the door on my legs (ow) and then she started begging for some orange and I shooed her away then gave her some peel.. The vet was doing her teeth and said, "She has the best breath I have ever smelled on a horse, kinda smells like oranges." I said, haha, I just gave her some orange peel..