Interactive virtual interface
Inventors
Luckey, Palmer F. • Levin, Jason • Hammerstein, Julian • Chen, Joseph • Wang, Maximillian Zheng
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-11182043-B2
Publication Date
2021-11-23
Expiration Date
Abstract
A system for display and interaction includes an interface and a processor. The interface is configured to receive data from one or more sensors. The processor is configured to convert the data to a common synthetic data space; provide the common synthetic data space for display; and receive a command associated with an object represented in the common synthetic data space. In some embodiments, the processor is coupled to a memory that stores instructions for the processor.
Core Innovation
The invention provides a system for user display and interaction that receives data from a plurality of sensors and converts the data to a common synthetic data space. The data is comprised of a plurality of layers, where each layer corresponds to received data corresponding to a sensor. The layers are aligned using one or more unchanged common features included in at least two of the plurality of layers so that the layered sensor data is converted into the common synthetic data space.
The unchanged common features include one or more objects that are present in the at least two of the plurality of layers. A first object of the plurality of objects is determined to be used as one of the one or more unchanged common features at least in part by comparing different versions of sensor data obtained at one of the plurality of layers. After conversion, at least one object of the plurality of objects is filtered from the common synthetic data space.
The common synthetic data space is provided for display and displays metadata associated with non-filtered objects. The manner of displaying the metadata indicates a confidence in the metadata and includes displaying metadata associated with an object and a confidence level for the metadata adjacent to the object. The system also provides controls based at least in part on a role, user ID, or rank, and receives a command associated with one of the non-filtered objects represented in the common synthetic data space based at least in part on the controls.
Claims Coverage
The independent claims cover a system, a method, and a computer program product that share the same core sequence of inventive features: multi-sensor conversion into an aligned common synthetic data space, filtering of objects, confidence-based metadata display for non-filtered objects, and role/user-based controls for receiving commands associated with displayed objects. The inventive features below reflect those core elements across the independent claim set.
Common synthetic data space conversion from layered multi-sensor data
Converting data to a common synthetic data space that includes a plurality of objects, wherein the data is comprised of a plurality of layers, wherein a layer of the plurality of layers corresponds to received data corresponding to a sensor of the plurality of sensors.
Alignment using unchanged common features/objects across layers
Aligning the plurality of layers using one or more unchanged common features included in at least two of the plurality of layers to convert the data to the common synthetic data space.
Selecting a first unchanged common feature object by comparing sensor-data versions
Determining a first object of the plurality of objects to be used as one of the one or more unchanged common features at least in part by comparing different versions of sensor data obtained at one of the plurality of layers, wherein the one or more unchanged common features include one or more objects that are present in the at least two of the plurality of layers.
Filtering objects from the common synthetic data space
Filtering at least one object of the plurality of objects from the common synthetic data space.
Confidence-indicating metadata display for non-filtered objects
Providing the common synthetic data space for display, wherein the common synthetic data space displays metadata associated with non-filtered objects of the plurality of objects, wherein the metadata indicates a confidence in the metadata and includes displaying metadata associated with an object and a confidence level adjacent to the object.
Role-, user ID-, or rank-based controls for object commands
Providing controls based at least in part on a role, user ID, or rank; and receiving a command associated with one of the non-filtered objects represented in the common synthetic data space based at least in part on the controls.
Across the independent claims, the inventive coverage is directed to converting plurality-of-sensor layered data into an aligned common synthetic data space using unchanged common features/objects (with selection of a first common feature object by comparing different versions of sensor data), filtering objects, displaying metadata for non-filtered objects with confidence indication and adjacent confidence levels, and enabling interaction by receiving object-associated commands through role/user ID/rank-based controls.
Stated Advantages
Documented Applications
No documented applications found
Interested in licensing this patent?