We don't answer at night. I have one friend who just loves to call and 'chat' after dinner while her DH is watching the evening talk shows (she is bored by politics) so I just let the answer machine pick up.
I had a neighbor who was a stalker and for a year, I never answered the phone.