I used to live there as well. I spent elementary school there, in the late seventies. Used to ride my bike across town to the library, which at the time was in this large white mansion (likely it's smaller than I remember).
Beautiful town, with streets covered in giant oaks and cobblestone roads in places.
It's still a beautiful city (I haven't lived there since 1995), and the library is *still* in the same building you described.