I bought my lad 4 months ago after 19 years of not owning a horse - I'm mid 40's have my warmblood x TB on a DIY yard, work full time, married, child etc. It is hard work, but the pleasure I have with him outweighs everything!
Life's too short - go for it - your only as old as you want to be!!!