A method of performing a shared artificial-reality interaction using an artificial-reality headset is provided. The method includes obtaining local data about a local physical area in which a user is wearing an artificial-reality headset. The method further includes identifying, via the local data, a local orientation of the user relative to the local physical area. The method further includes obtaining remote data indicating a remote orientation of a remote user relative to a remote physical landmark within a remote physical area different than the local physical area. And the method further includes, based on the local data, the local orientation of the user, and the remote data, and presenting, at the artificial-reality headset, a visual representation of the remote user at a co-present position within the local physical area with a representative orientation relative to (i) the local physical landmark and (ii) the local orientation of the user.
First-named inventor. This is the mixed-reality co-presence work I designed and prototyped at Meta Reality Labs: rather than placing a remote participant at an arbitrary point in your room, the system reads the physical landmarks around both people and positions the remote person’s representation so that the shared space makes sense from each side.
Filed 13 December 2024, published 26 June 2025. Application pending.