Looks like it would be pretty hard to confuse the address with the flag immediately outside the door frame.
Did you read the article? The house houses two families. It is on a corner, I.e. facing two different streets. Each of the two entrances, to the two residences, had a different street address. It was the other tenants at the other address who hung the Nazi flag.