Maybe not, if it was just a kitten. I believe it takes awhile before a cat starts producing allergens.
I try to limit my direct exposure, regardless of the cat’s age.
My Dad’s cats, oddly, don’t bother me at all. He brushes them daily, and his wife keeps the house very clean.
Mine are all outdoor types ... they follow me around whenever I’m working the property. They run away whenever I start an engine, then re-appear as soon as I cut power.