"So then 'faith' comes by hearing, and hearing by the word of God." - Romans 10:17
"Faith" does not come through ancient rocks and baroque embellishments. It comes through Christ's Word in us, which we receive by hearing His Word.
I would agree that the Word can be spoken through "things" but only in this sense. When we see a painting, a cross, a crucifix, etc., that expressed the Word of God, those pictures, images, things - explained to the hearer in terms of how they relate to the gospel, can produce faith. E.g., when a crucifix is used to explain the sacrifice and death of Jesus, the crucifix becomes a compliment to the gospel. The problem many see in Catholicism is that there are Catholics who worship the object. Words like veneration are used to explain that the objects are not being worshiped. However, when Christians see a person praying before a statue or carrying a "blessed" medal like a talisman, the veneration argument rings untrue.
You are evidently proud of your church. I would encourage you to be proud of your Christ and His greatness!
Christ is great and so His Church is great. Beauty is a necessary component of our faith.