The saddle is so often the limiting factor, make sure the back length can take a saddle that can also take you!
https://www.ahsaddles.com/post/2019/04/30/horse-shopping-saddle-length-part-1
Very very true. My Connie took 6ft rugs so had plenty of room for a 17inch saddle which really helped. It’s very important as a taller person to make sure you are sitting in the middle of the saddle, not pushed to the back of the saddle over the loins. I always get on better with straight cut saddles and longer stirrups on smaller ponies.