Nope you have no legal obligation to give them back the deposit and I genuinely wouldn't. It is your right to keep it to cover costs of readvertising, taking time off work to show him off again etc- or to put down on another horse
the problem is i've used the deposit for a deposit on a new horse them not having my youngster has now given me a problem on paying for the new horse grrr!!!