I’m just saying.
The term is entirely neutral.
Bogus charge against the guy. Completely bogus.
Exactly. It is a very common phrase.