I used to get that a lot at one of the places I worked. I worked 30 miles from home and got pretty tired of all that driving so never did want to drive back into town to do stuff with *work* people! One of my neighbors worked at the same place and thought the same way. Therefore, we were both accused of not being team players.
We got even. Our boss was lecturing us at a department meeting for not showing up at stuff etc. We volunteered to plan the next picnic. We planned it at a place closer to our houses but 15 miles in the other direction from work. hehehe.... only 7 people were willing to drive that far on their Saturday off! We were *even*!!!
Now THAT was genious!