I go most years on my birthday. We love it. We avoid Bourbon Street like the plague. Great restaurants, beautiful French Quarter, great bars.
I go to New Orleans more than I want to because of work. But the best reasons for going are the same as your reasons for going (only reasons for going). We're in and out in two days and then we make reservations at our favorite restaurants for the next trip.
I looked at the city differently when I was in my 20's.