Vinegar or peroxide in a baking soda paste make great cleaners.
Vinegar is an acid. Baking soda is a base. When you mix them together CO2 is released and a salt is left behind. If the balance is just right, the solution will be neutral, neither acid or base. Otherwise, the remaining solution will be either an acid or a base, and salty.
This is chemistry. It can't be avoided.