Just make sure they are NICE horses!
I got one once in Hawaii that decided he hated me.
I ended up changing horses in midstream with the riding leader.
Mine liked me as soon as he learned that I kept a couple of Carrots or a sliced Apple in my Hat. Did you learn that trick for a treat for him?