Actually, people back then could count to nine. "Son of Mary" is, in a patriarchal culture, another way of saying "father unknown." A taint that dogged our Lord wherever the family moved.
Where did you get that last sentence from. By working backwards from your conclusion?