There's not much wrong with that hymn, either, WRT Catholic teaching. (The "no thanks to them abideth" part is the most problematical, IMO.)
Great hymn....of course I grew up Lutheran and those Germans would shake the rafters!