They figured out that it was a library when they found a sign that said: Silentium.
Silentium...
Clever comment there, Verginius Rufus!