Mushrooms as in the ones you buy from the supermarket, yes, they would do no harm. However, if the horse were to get a taste for them, which although unlikely but horses can have aqquired tastes, it would be very bad. The most poisonous mushrooms and toadstools can taste identical to edible ones, deathcaps are often enjoyed in a rissoto before organ failure commences!!