Stand firm! Its tough but it must be done. We were fortunate to have someone to put the baby in with so they weren't alone. Our first went in with another mare and our last two have always had each other so were weaned together.
Do you have someone you can put in with baby?
"Until one has loved an animal, part of one's soul remains unawakened..."
- Anatole France