For anyone else interested, the feature is called 'inline AutoComplete'. It sort of reads your mind and starts filling in the rest of the url for you. I too thought it was annoying and unnecessary and turned it off.
Again, to do so, click Tools->Internet Options->Advanced.
Then remove the check mark beside "Use Inline AutoComplete".