Selecting virtual objects in a three-dimensional space
Inventors
Powderly, James M. • Niles, Savannah • Hamilton, Frank • Fontaine, Marshal A. • Abovitz, Rony • Naples, Alysha
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12474788-B2
Publication Date
2025-11-18
Expiration Date
Abstract
Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.
Core Innovation
A method is provided for selecting an interactable object located in three-dimensional (3D) space within an augmented reality (AR) system. The AR system is configured to permit user interaction with an interactable object in a field of regard (FOR) of a user, where the FOR includes a portion of the environment around the user capable of being perceived via the AR system.
The method determines a group of interactable objects associated with virtual objects in the FOR and determines a pose of the user. The method selects a target interactable object from among the group of interactable objects based at least partly on the pose of the user, associates a focus indicator with the selected target interactable object, and initiates a selection event on the selected target surface based at least partly on input of the user input device.
The method further determines the user’s field of view (FOV) from the user’s pose, accesses contextual information about interactable objects within that FOV, and provides user-input-mode options based at least partly on the contextual information. The focus indicator is updated to show that the current user input mode has changed, linking focus-indicator behavior to changes in user input mode.
A further related method is provided for interacting with virtual objects in a 3D environment by determining a pose of a user and displaying a first focus indicator associated with a target interactable object in a direction related to the pose, where the target interactable object comprises a plurality of virtual objects. After receiving a selection of the target interactable object, the method displays the plurality of virtual objects, displays a second focus indicator associated with a target virtual object, and updates the second focus indicator based at least partly on input from the user input device.
Claims Coverage
The partial content provides two independent methods: one for selecting an interactable object in 3D space and one for interacting with virtual objects via first and second focus indicators. The merged coverage includes 5 inventive features.
Selecting a target interactable object based on user pose within a field of regard
Determining a group of interactable objects associated with virtual objects in the FOR of the user, determining a pose of the user, and selecting a target interactable object from among the group of interactable objects based at least partly on the pose of the user.
Associating a focus indicator and initiating a selection event using user input
Associating a focus indicator to the selected target interactable object and initiating a selection event on the selected target surface based at least partly on an input of the user input device.
Pose-based field of view with contextual user input mode options
Determining the user’s field of view from the user’s pose, accessing contextual information about interactable objects within the field of view, and providing user-input-mode options based at least partly on the contextual information.
Updating focus indicator based on changes in user input mode
Updating the focus indicator to show that the current user input mode has changed.
Displaying first and second focus indicators for virtual object interaction
Determining a pose of a user; displaying a first focus indicator associated with a target interactable object in a direction related to the pose of the user, wherein the target interactable object comprises a plurality of virtual objects; receiving a selection of the target interactable object; displaying the plurality of virtual objects; displaying a second focus indicator associated with a target virtual object; and updating the second focus indicator based at least partly on input from the user input device.
Across the independent claims, the coverage centers on pose-based determination of a target for interactable object selection and pose-associated focus indicators that are updated based on user input, including contextual switching of user input modes and a two-stage focus indicator workflow for target interactable objects containing multiple virtual objects.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?