Spatial instructions and guides in mixed reality

Inventors

ARORA, Tushar • Kramarich, Scott

Assignees

Magic Leap Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12430860-B2

Patent

Publication Date

2025-09-30

Expiration Date


Abstract

Exemplary systems and methods for creating spatial contents in a mixed reality environment are disclosed. In an example, a location associated with a first user in a coordinate space is determined. A persistent virtual content is generated. The persistent virtual content is associated with the first user's associated location. The first user's associated location is determined and is associated with the persistent virtual content. A location of a second user at a second time in the coordinate space is determined. The persistent virtual content is presented to the second user via a display at a location in the coordinate space corresponding to the first user's associated location.

Core Innovation

The invention relates to mixed-reality spatial instructions and guides (SIG) in which user inputs are spatially localized in a coordinate space. A movement-related input from a user is used to generate content that is associated with the input and further associated with a recorded user’s location/time. The resulting virtual content is persistent in the coordinate space, so it remains tied to where it is recorded.

The described system context includes shared real/virtual coordinate systems and a persistent coordinate system, with optional physical/virtual correspondence for virtual objects. Spatial markers and virtual markings are used to create SIG events, including optional audio/video. SIG recording sessions and SIG playback sessions are supported, and playback is synchronized across multiple users.

During playback, the system determines and updates locations associated with users. Location determination and update is based on GPS, wireless triangulation/fingerprinting, landmark recognition, and accuracy/confidence radius logic. The system includes a wearable head device with sensors and components for position/orientation tracking, including SLAM and visual odometry, and supports audio spatialization, enabling the SIG content to be presented in relation to user location and timing.

Claims Coverage

The partial content includes three independent claim types: a method, a system, and a non-transitory computer-readable medium. Across these independents, the core inventive features are centered on location-associated content generation from movement input and conditional, threshold-distance-based concurrent presentation to multiple users.

Location-associated content generation from movement input

receiving an input from a first user, the input indicative of a movement of the first user; determining, via a sensor, a location associated with the first user; generating content corresponding to the input, the content associated with the movement of the first user and further associated with the location associated with the first user;

Conditional presentation to a second user based on threshold distance

determining a first location of a second user; determining, based on the location associated with the first user and based further on the first location of the second user, whether to present the content to the second user; in accordance with a determination to present the content to the second user: presenting, via a display, the content to the second user; determining whether a second location of the second user is within a threshold distance from the first location of the second user; in accordance with a determination that the second location of the second user is not within the threshold distance, pausing the presenting the content to the second user; in accordance with a determination that the second location of the second user is within the threshold distance, forgoing pausing the presenting the content to the second user; and in accordance with a determination not to present the content to the second user, forgoing presenting the content to the second user.

Concurrent multi-user presentation based on a second threshold distance

while the content is presented to the second user, determining a location of a third user; and in accordance with a determination that the location of the third user is within a second threshold distance from the first location of the second user, presenting, via a second display, the content to the third user concurrently with the presenting the content to the second user.

Across the independent claims, the invention generates content tied to a first user’s movement and location, determines whether to present that content to a second user, pauses presentation based on whether the second user remains within a threshold distance, and concurrently presents to a third user when the third user is within a second threshold distance.

Stated Advantages

Not explicitly described in patent.

Documented Applications

Not explicitly described in patent.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.