Try some dishwash soap and water in a spray bottle.
That works well if spraying is done frequently. If you have aphid infestations you probably have lots of ants too. It's not well known but ants actually "herd" aphids into foliage so they can feed on the "honeydew" produced by the aphids. I am NOT making this up! Aphids I had lots of aphid problems in my garden until I decided to get serious about eliminating ants. Now both are gone.