The thing is that very few people live in the Southwestern Louisiana coast. It struck hardest at the most lightly populated area on the gulf.
And on the Texas side, pretty much everyone got out anyway, so Rita mostly trashed empty buildings.