If it's a latex primer, you could paint within an hour, I believe. Check the can, but I know it dries pretty quickly! You could certainly get a coat of primer and one finish coat done on Saturday.
I love the smell of fresh paint.