We have a word for infinity too.
Yes, because we can also conceive of that. We invent words to name things that we can conceive of.