You work where the job requires, and to the work they require you to do.
If you don’t like it, quit and find another job.
There’s no shortage of companies to work for…
The people on the teams I work with are invariably scattered all across the country and sometimes overseas as well. So going into the office is not going to matter as far as that’s concerned.
I also don’t have to waste an uncompensated hour and a half of my day commuting nor spend all the money (clothes, gas, food, parking, daycare, etc) associated with commuting. I’m also not under the thumb of HR. I also don’t have to put up with all the noise you constantly hear from an entire floor of a big tower where the banks have their offices. While we still have useless time wasting meetings, I find there are fewer of them and for a lot of them you can just log in, hit the mute button and keep on working undisturbed. When there is nothing to do which does happen sometimes, you can do household chores or just watch TV for an hour instead of having to sit there trying to look busy.