I suppose pointing out that the Magi didn’t visit the manger in Bethlehem wouldn’t matter. They visited a “house,” most likely the family home in Nazareth.
You are right... it doesn’t matter.