Systems and methods for data transmission and rendering of virtual objects for display
Inventors
Pavloff, Alexander G. • Redd, Bryan L.
Assignees
Publication Number
US-12340470-B2
Publication Date
2025-06-24
Expiration Date
2039-09-23
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
System and methods are disclosed for displaying real-time, geo-registered data in an augmented reality or other virtual environment. The system and methods may be configured to supply missing information from the real-time, geo-registered data set in order to facilitate the display in three dimensions.
Core Innovation
Exemplary embodiments disclosed provide software solutions for use with computer displays and augmented reality (AR) and/or virtual reality (VR) systems to generate a "geo-capable" device that functions within a world-wide reference frame. This device understands where the user is looking, enabling real-time display of geo-registered information projected in three dimensions using Latitude, Longitude, and Altitude coordinates. The system is hardware agnostic and deployable to suitably equipped AR/VR systems, supporting the user's situational understanding by integrating detailed local environment data.
The system addresses technical challenges in rendering virtual objects over physical environments that include variations in elevation such as valleys, hills, and mountains. Conventional AR systems lack global positioning capabilities or only provide local reference frames without relation to global coordinates, limiting their outdoor functionality and their ability to overlay virtual objects accurately relative to physical locations in a 3D environment. Few existing systems can supply missing data, handle large data transfers, or manage real-time 3D rendering efficiently.
To overcome these issues, exemplary embodiments include transforming, augmenting, and simplifying multiple heterogeneous real-time geospatial data sets to create a uniform, three-dimensional mesh representing the physical environment. The system can supply missing elevation data or other attributes by combining available data or generating approximations. It also optimizes device resource use by selectively reducing data resolution based on the user's location and viewing orientation, thus enabling efficient, real-time rendering of geo-registered virtual objects on wearable or mobile AR/VR devices even with limited processing power and battery life.
Claims Coverage
The patent includes two independent claims focusing on methods for augmented reality data handling and rendering.
Georegistered virtual object rendering from multiple vessel data sets
Receiving first and second real-time data sets comprising geolocation and vessel information, respectively; updating vessel locations; converting data to a common reference frame relative to the augmented reality headset; and generating real-time virtual objects corresponding to each vessel, accurately rendered according to their geo-positions.
Georegistered alignment and overlay of synchronized video and external georeferenced data
Receiving a georegistered sequential image/video data set and one or more external georegistered data sets; receiving synchronous metadata for accurate georegistration; aligning and adjusting the external data relative to the video using the metadata; and generating still or video objects with virtual object overlays precisely positioned for realistic augmented reality display.
The independent claims cover inventive features for receiving, processing, converting, and rendering real-time geospatial data and video with precise georegistration to generate virtual objects in augmented reality environments, focusing on reference frame unification, data set updating, synchronization, and user interaction.
Stated Advantages
Enables real-time display of geo-registered information in three dimensions on AR/VR devices, enhancing situational awareness.
Supplies missing data in heterogeneous data sets by combining or approximating elevation and other physical attributes, overcoming limitations of incomplete geo-data.
Optimizes device resource usage by reducing data resolution and complexity based on user location and orientation, improving processing efficiency and battery life.
Is hardware agnostic and adaptable to various AR/VR systems, supporting flexible deployment.
Supports integration of multiple data formats and coordinate systems, enabling accurate reference frame conversion and overlay.
Facilitates synchronization and precise alignment of video or sequential imagery with georeferenced virtual object overlays for enhanced visualization.
Documented Applications
Utility inspection applications integrating precision geo-registered 3D information into video streams for infrastructure monitoring.
Real-time visualization of aircraft or other GNSS-tracked vehicles and assets using ADS-B or similar transponder data in augmented reality.
Disaster recovery situational understanding by overlaying virtual objects representing destroyed or inaccessible landmarks or structures.
Mission planning and asset tracking in military or commercial scenarios providing overview and 1:1 scale views of terrain and units.
Management of large infrastructure networks such as power lines, communication lines, or utilities, showing obscured or unreachable assets.
Creation of interactive 3D enriched urban terrain maps and integrated visual ensembles for situational awareness in various fields.
Interested in licensing this patent?