Actually one should reply with “Are you a law enforcement officer? Because I do not answer questions from law enforcement without the presence of my attorney.”
So if it is an undercover cop, it establishes the fact that you wish to remain silent. If it is a street thug, it will confuse him.
LOL - you're right - they might assume you're in the mob...