He didn't invent THE telescope, but he did invent a telescope of his own design. He states in The Assayer that having heard of such a thing, he was inspired to put his mind to it, but that he wasn't aided by any knowledge of a design. He was quite proud of himself, and bragged about the "perfection" of his instrument, and I believe that his telescopes did exceed any others at the time in magnifying power.
Thats what my understanding of his building of his telescope was too.