I've found less friction in my experience. I prefer pair programming remotely over in person.

Pair Programming in person - one computer & one person looking over another's shoulder usually.

Pair Programming remotely - two computers & you can easily swap control of either's device or change who's sharing their screen.

The only thing working in an office wins on imo is building very close relationships with co-workers. I think physical presence is a human thing that cannot be beat. You can still build great relationships remotely but they're not the same. From the point of view of a company, remote relationships might be good enough or even better as they can prevent people becoming "to close" and ending up on the news at a concert together.