It really depends on whether you are colocated with your team or not. When I was working, my team of 20 had only two or three people in each location - New Jersey, Columbus, Bournemouth, Mumbai, Texas. It really didn’t make any difference whether you came in to the office, and I used to log in from home at 7 AM to catch the guys in Mumbai, and shut down at 7 PM when my boss in Chicago went home for the day.
That’s a great example were working remotely works well because it’s necessary.