Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions

Inventors

Samec, Nicole ElizabethHarrises, Christopher M.Baerenrodt, MarkMangiat, Stephen VincentRobaina, Nastasja U.Wright, Adam Carl

Assignees

Magic Leap Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12482197-B2

Patent

Publication Date

2025-11-25

Expiration Date


Abstract

In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. In some embodiments, the perception aid may include a reminder, an alert, or virtual content that changes a property, e.g. a color, of a real object. The augmented reality display may be configured to display virtual content by outputting light with variable wavefront divergence, and to provide an accommodation-vergence mismatch of less than 0.5 diopters, including less than 0.25 diopters.

Core Innovation

A head-mounted display system projects light to a user to display augmented reality image content using one or more waveguides that project the light to the user and transmit light from a surrounding environment. The system includes outwardly-facing sensors to monitor the environment and inwardly-facing sensors to track ocular characteristics of the user.

Based on the tracked ocular characteristics, the system determines an actual physical or behavioral reaction of the user to an object in the environment and an expected physical or behavioral reaction of the user to the object. The system determines whether the expected reaction is targeted for modification, compares the actual reaction to the expected reaction when modification is targeted, and presents augmented reality content such that the actual reaction matches the expected reaction.

In an emotional variant, the system determines an actual emotional reaction of the user to an object based at least in part on tracked ocular characteristics, determines an expected emotional reaction, and determines whether the expected emotional reaction is targeted for modification. When the actual emotional reaction differs from the expected emotional reaction under modification targeting, augmented reality content is presented such that the actual emotional reaction matches the expected emotional reaction.

Claims Coverage

Two independent claims are identified. Each independent claim centers on a head-mounted augmented reality display using waveguides and sensors to track ocular characteristics, determine an actual reaction versus an expected reaction, and present augmented reality content when modification is targeted so that the actual reaction matches the expected reaction.

Waveguide-based head-mounted augmented reality with environment transmission

A head-mounted display projects light to a user to display augmented reality image content, including one or more waveguides configured to project the light to the user and to transmit light from a surrounding environment.

Outward and inward sensor reaction assessment

An outwardly-facing sensor monitors the environment and an inwardly-facing sensor tracks ocular characteristics of the user to determine an actual physical or behavioral reaction or an actual emotional reaction of the user to an object in the environment based at least in part on the tracked ocular characteristics.

Actual versus expected reaction comparison with modification targeting

The display system determines an expected physical or behavioral reaction or expected emotional reaction of the user to the object, determines whether the expected reaction is targeted for modification, and compares the actual reaction to the expected reaction when modification is targeted.

Augmented reality content presentation to match expected reaction

When the actual reaction differs from the expected reaction and the expected reaction is targeted for modification, the display system presents augmented reality content such that the actual reaction matches the expected reaction.

Across the independent claims, the inventive core is a head-mounted augmented reality display using waveguides and sensors to track ocular characteristics, determine actual versus expected physical, behavioral, or emotional reactions to environment objects, and present augmented reality content when targeted modification is indicated so that the actual reaction matches the expected reaction.

Stated Advantages

Augmented reality content is presented so the actual physical or behavioral reaction matches the expected physical or behavioral reaction.

Augmented reality content is presented so the actual emotional reaction matches the expected emotional reaction.

A neurological condition can be determined by comparing measured physical or behavioral reactions to expected physical or behavioral reactions, including an abnormality.

Documented Applications

Eye-tracking-based neurological assessment concepts, including smooth pursuit impairments, vestibulo-ocular reflex assessment, nystagmus/oscillopsia monitoring, head-tilt testing, optokinetic nystagmus testing, convergence testing, and pupillary/retinal function assessments, combined with perception aids that use augmented content to reorient and/or match expected reactions.

Use of a head-mounted augmented-reality display system that determines physical/behavioral or emotional reactions from tracked ocular characteristics and conditionally presents augmented reality content to modify those reactions toward an expected reaction.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.