If you're going many days without any human interaction, then the issue isn't your inability to force your colleagues into the same physical space with you. The issue is that you're confusing your colleagues for a personal social support network.
Remote or in-office, that's not healthy. Go outside. Make real friendships with people you don't work with. And if you're struggling with that, then seek help. But don't force me into a car for 10 hours per week, just to help you fake a social support network.
There are those that end up cleaning up after everyone else that don't necessarily have the time to do that because the work needs to get done or someone gets blocked. I envy the people that get to clock out at the normal time, and are free to not consider downstream effects of what they do because that would take too much time away from their social endeavors. At least with WFH, you generally have enough contact info to call that sort of thing out, and ideally, wort it out.
Remote or in-office, that's not healthy. Go outside. Make real friendships with people you don't work with. And if you're struggling with that, then seek help. But don't force me into a car for 10 hours per week, just to help you fake a social support network.