I have been to the convention center, just last weekend, and the streets (Howard, etc) were pristine. Also down Howard up to Central Computer.
I generally eschew the Tenderloin and the Castro. But I was in the tenderloin about 6 or 7 years ago, it doesn't feel dangerous like an East Coast city.