If you live in Germany...as a foreigner...you are required to have your passport on your person. Any federal cop...because there are no state or local cops...has the authority to ask who you are and to identify yourself. I spent sixteen years going through the system and appreciate the way it works.
Foreigners have the same requirement here, too. We just don't enforce it.