People don't worship the wall. They worship at the wall.
Christians also do not worship churches.
In theory, that is true. Yet, the way people react when these places get destroyed, or occupied by another country, suggests to me that at some level the walls themselves at some level become and object of worship.