We do that all the time with the Cape and Maine coast.
Go off season
Saves lots of $$$, have the place almost to yourself and still good restaurants to be found open.
Indoor pool is a plus but i also love the rustic approach too.
We are using things like VRBO to find places on the ocean up in Maine, and boy, do I love that. To me, being able to go out on a deck at night, have a beer and smoke my pipe is as good as it gets for me at my age now!
It costs more than a hotel or Bed and Breakfast, but...as I get older, I just enjoy that solitude and freedom renting a house gives.