Did they have language?
Yes, but their voice box is quite high in the throat, possibly an Ice Age adaptation. Speech would be somewhat less articulate..