Displaying an environment from a selected point-of-view
Inventors
Feng, Dan • Manglik, Aashi • O'Hern, Adam M. • MORGAN, Bo • Peebler, Bradley W. • Kovacs, Daniel L. • Ahn, Edward • Moll, James • Drummond, Mark E. • Chua, Michelle • Qiao, Mu • Gamboa, Noah • Jotwani, Payal • Sivapurapu, Siva Chandra Mouli
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12474814-B2
Publication Date
2025-11-18
Expiration Date
Abstract
A device obtains a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.
Core Innovation
The disclosed systems and methods present a graphical environment in an extended reality (XR) environment from a selected point-of-view (POV). A request to display the environment is obtained, and the graphical environment is displayed on a display from a first POV associated with a first camera rig that performs a first type of movement. The disclosure then selects a second POV to display the graphical environment from the second POV.
The second POV is selected based on speech input received via an audio sensor and an input obtained via an input device. The selection can include disambiguating the speech input using highest-saliency object or portion, and can also consider object relationships and contextual data about the device or the user.
The second POV is associated with a second camera rig that is different from the first camera rig and performs a second type of movement. The camera rig can move or switch among multiple rigs or rig types to maintain object visibility, including handling occlusions or obstacles and movement distance thresholds.
Rig paths with intermediary POVs and obstacles-aware navigation are described, and POVs are tailored to virtual character types, such as differing fields of view and POV heights including character POV versus dog POV, as well as tabletop POV modes.
Claims Coverage
The independent claim set includes three independent claims: method, device, and non-transitory memory. Across them, the claims center on switching between a first POV and a second POV in a graphical environment using speech input plus another input, where the POVs are tied to different camera rigs that perform different movement types.
Camera rig-associated POV switching in an XR graphical environment
Displaying, on a display, a graphical environment from a first point-of-view (POV) associated with a first camera rig that performs a first type of movement; selecting a second POV; and displaying the graphical environment from the second POV associated with a second camera rig that is different from the first camera rig and performs a second type of movement.
Speech-based second POV selection using additional input
Selecting a second POV based on a speech input received via the audio sensor and an input obtained via the input device.
Programmed device execution for camera-rig POV switching
A device comprising one or more processors and one or more programs stored in non-transitory memory, which when executed cause the device to display a graphical environment from a first POV associated with a first camera rig performing a first type of movement, select a second POV based on speech input received via the audio sensor and an input obtained via the input device, and display the graphical environment from the second POV associated with a second camera rig different from the first camera rig and performing a second type of movement.
Overall claim coverage includes displaying the graphical environment from a first POV tied to a first camera rig and movement type, selecting a second POV based on speech input plus an input device input, and displaying from a second POV tied to a different camera rig and a second movement type, implemented as a method, a device, and a non-transitory memory program.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?