Display systems and methods for determining registration between a display and a user's eyes
Inventors
Edwin, Lionel Ernest • Nienstedt, Zachary C. • YEOH, Ivan Li Chuen • Miller, Samuel A • Xu, Yan • Cazamias, Jordan Alexander
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12474575-B2
Publication Date
2025-11-18
Expiration Date
Abstract
A display system may include a head-mounted display (HMD) for rendering a three-dimensional virtual object which appears to be located in an ambient environment of a user of the display. One or more eyes of the user may not be in desired positions, relative to the HMD, to receive, or register, image information outputted by the HMD and/or to view an external environment. For example, the HMD-to-eye alignment may vary for different users and/or may change over time (e.g., as the HMD is displaced). The display system may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and/or may take actions to reduce or minimize effects of any misalignment.
Core Innovation
The invention defines a display system configured to project light to an eye of a user to display virtual image content, with the virtual image content appearing to be located at different depths while an external environment is viewable. A frame is supported on a head of the user and includes a display disposed on the frame, and the display projects light into the eye with different amounts of wavefront divergence to present depth based virtual image content.
The invention determines a display registration volume relative to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume. It also determines a housing registration volume relative to the frame such that an external field of view proximal to the display is viewable by the eye while the eye is situated within the housing registration volume, and then determines a combined registration volume that includes points included in both volumes.
Using one or more eye-tracking cameras, the invention determines a three-dimensional position of the eye based on one or more images of the eye. It determines whether the eye position is within the combined registration volume and controls operation of the display based on that determination, including providing a notification of misregistration when the eye is not within the combined registration volume.
The description further specifies registration volume geometry and positioning relationships, including frustum-shaped and angled registration volumes and defining a housing registration volume based on housing/frame openings. It also relates registration volume to application type and discusses registration viewing volume concepts based on overlap or intersection of emitted light fields across a field of view, including an analogous housing registration volume based on ambient light passing through openings.
Claims Coverage
The independent claim set includes three independent claims. Across these claims, the core inventive features include defining display and housing registration volumes, determining a combined registration volume, determining a 3D eye position from eye-tracking images, checking whether the eye lies within the combined registration volume, and controlling the display including user notification of misregistration; additional coverage includes implementing the functionality as computer-readable instructions and as a computer-implemented method.
Wavefront-divergence depth virtual content with registration-volume control
A display system configured to project light to an eye to display virtual image content with different amounts of wavefront divergence, while an external environment is viewable, and to control operation based on eye position relative to registration volumes.
Display registration volume relative to the display for receiving virtual image content
Determining a display registration volume relative to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume.
Housing registration volume relative to the frame for viewing an external field of view
Determining a housing registration volume relative to the frame such that an external field of view of an external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume.
Combined registration volume overlap of display and housing registration volumes
Determining a combined registration volume that includes points included in both the display registration volume and the housing registration volume.
3D eye position determination from eye-tracking camera images
Determining a three-dimensional position of the eye based on one or more images of the eye obtained with one or more eye-tracking cameras.
Misregistration check and user notification based on being outside the combined registration volume
Determining whether the position of the eye is within the combined registration volume; controlling operation of the display based on the determining, including providing a notification of misregistration when the eye is not within the combined registration volume.
Non-transitory computer-readable medium instructions for registration-volume control
Non-transitory computer-readable storage media storing instructions that, when executed, instruct a processor to perform operations including determining display and housing registration volumes, determining a combined registration volume, determining a 3D eye position from eye-tracking images, checking the position relative to the combined registration volume, and controlling display operation including providing a notification of misregistration.
Computer-implemented method for registration-volume control including misregistration notification
A computer-implemented method for controlling a wearable display including determining display registration volume, determining housing registration volume, determining combined registration volume, determining 3D eye position based on eye-tracking camera images, determining whether the eye position is within the combined registration volume, and controlling operation including providing a notification of misregistration.
The independent claims collectively cover a wearable or head-mounted display system and corresponding computer-readable medium and computer-implemented method in which display and housing registration volumes are defined, a combined registration volume is formed, a 3D eye position is determined from eye-tracking images, and the display is controlled with a user notification of misregistration when the eye is not within the combined registration volume.
Stated Advantages
Provides a user notification of misregistration when the eye is not within the combined registration volume.
Enables the external environment to be viewable while virtual image content is presented with depth cues based on wavefront divergence.
Allows the external field of view to be viewable by the eye while the eye is within the housing registration volume.
Ensures virtual image content is received by the eye while the eye is within the display registration volume.
Documented Applications
A head-mounted or light-field style display scenario using eye tracking to register a display registration volume and a housing registration volume so that virtual image content is received and an external field of view is viewable, with misregistration notification.
Application-dependent registration volume definition based on the type of application associated with virtual content presented through the display.
Interested in licensing this patent?