You are correct, my mistake there. They were in Egypt until Herod the Great died which was in 4BC when they came back shortly thereafter.
JB
ahhh...so I did learn something in religion class!