Is there a good time to go to avoid the crowds? Assuming there are crowds.
Yes, first thing Saturday morning or Sunday morning. Get in early and you’ll find a nice parking space! The worker bees of Washington tend not to stir too early on weekends.