Systems for augmented reality visual aids and tools
Inventors
Watola, David • Cormier, Jay E. • Kim, Brian
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12033291-B2
Publication Date
2024-07-09
Expiration Date
Abstract
Adaptive Control Driven System/ACDS 99, supports visual enhancement, mitigation of challenges and with basic image modification algorithms and any known hardware from contact lenses to IOLs to AR hardware glasses, and enables users to enhance vision with user interface based on a series of adjustments that are applied to move, modify, or reshape image sets and components with full advantage of the remaining useful retinal area, thus addressing aspects of visual challenges heretofore inaccessible by devices which learn needed adjustments.
Core Innovation
The invention provides autonomous enhancements to a video output of a visual aid device by obtaining real-time images of a scene with the visual aid device. The system evaluates a motion component of the visual aid device and determines a motion state based on the motion component. Depending on whether the motion state indicates that a user is engaged in head motions that exceed a motion threshold, the invention selects between two presentation modes for video images.
When the motion state indicates head motions that exceed the motion threshold, the invention presents first video images on a display of the visual aid device in a neutral setting with limited enhancements or adjustments applied to the real-time images. When the motion state indicates head motions that do not exceed the motion threshold, the invention locates text-like features in a high-acuity portion of the real-time images. The invention then applies visual enhancements to at least the text-like features and presents second video images including the visually enhanced text-like features on the display.
In the enhanced condition, the invention characterizes enhancements to text-like features for visual utility such as reading by applying visual enhancements to at least the text-like features. The dependents further describe specific forms of visual enhancements including color mapping or binarization to provide high-contrast two-level images, and tiered-radial warp with moderate magnification. Additional refinement includes receiving user input indicating a spotting configuration and reducing magnification of the second video images to restore a more natural and less-distorted field-of-view.
Claims Coverage
The independent claim defines a method with at least one key decision feature controlled by a motion state derived from a motion component. The inventive features cover two presentation modes: neutral limited enhancements during head motions exceeding a threshold, and enhanced text-like features during head motions not exceeding the threshold.
Autonomous enhancement selection based on motion state
Obtain real-time images of a scene; evaluate a motion component of the visual aid device; determine a motion state based on the motion component; present first video images in a neutral setting with limited enhancements or adjustments when the motion state indicates head motions exceed a motion threshold, and present second video images with enhanced text-like features when the motion state indicates head motions do not exceed the motion threshold.
Text-like feature enhancement in a high-acuity portion
Locate text-like features in a high-acuity portion of the real-time images when head motions do not exceed the motion threshold; apply visual enhancements to at least the text-like features; present second video images including the visually enhanced text-like features on the display of the visual aid device.
Color mapping or binarization for high-contrast two-level text-like features
Apply visual enhancements comprising color mapping to give high-contrast two-level images and/or apply visual enhancements comprising binarization to give high-contrast two-level images.
Tiered radial warp with moderate magnification for enhanced text-like features
Apply visual enhancements comprising a tiered-radial warp with moderate magnification.
User-requested spotting configuration with magnification reduction
Receive an input from the user indicating a spotting configuration; reduce a magnification of the second video images to restore a more natural and less-distorted field-of-view.
Overall, the claim coverage centers on motion-state-dependent autonomous enhancement of real-time video output, with enhanced presentation focused on locating and enhancing text-like features in a high-acuity portion, optionally using high-contrast color mapping or binarization, tiered-radial warping with moderate magnification, and a user-selected spotting configuration that reduces magnification.
Stated Advantages
Maintains a neutral setting with limited enhancements or adjustments when head motions exceed a motion threshold.
Enables visual enhancements applied to text-like features when head motions do not exceed the motion threshold.
Provides high-contrast two-level images for visually enhanced text-like features.
Supports restoring a more natural and less-distorted field-of-view by reducing magnification for a spotting configuration.
Documented Applications
Autonomous enhancements to the video output of a visual aid device using real-time camera images with a motion threshold decision for presenting neutral limited enhancements versus enhanced text-like features.
Text-like feature enhancement for reading within a high-acuity portion of real-time images on a visual aid device display.
Spotting configuration presentation in which user input triggers magnification reduction to restore a more natural, less-distorted field-of-view.
Interested in licensing this patent?