As long as you enjoy it then fine. My wife is much like you and spends hours just walking among the flowers sand picking any weed daring to attempt a life in her garden.
My mother and my sister were avid gardeners (flowers) and my daddy had a huge vegetable garden.
The only thing I grow is grass and I’d rather have astroturf.
But.... I love to look at other people’s flowers.