It looks like a much-older-than-Victorian church.
The story is that it was first found in 1835. Here is a site with lots of pictures:
https://www.kuriositas.com/2015/05/the-mystery-of-margate-shell-grotto.html
Yeah, I think anyone holding out for Dagon knows where to send their tithe money, now.