Virtual and augmented reality telecommunication platforms
Inventors
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12067324-B2
Publication Date
2024-08-20
Expiration Date
Abstract
Provided herein are clinical evaluation and treatment as well as training protocols in virtual or augmented reality that create fully immersive environments, which enable real-time rendering for communication, specifically telecommunication, between two or more parties. In various embodiments, a virtual environment is provided to a first user at a first location. A first set of data comprising positional data of the first user is provided to a second user (e.g., an instructor) at a second location. An activity (e.g., a treatment or assessment protocol) may be received from the second user (e.g., an instructor) and the activity may be displayed to the first user via layering the activity over the virtual environment. An adjustment may be applied to the activity by the second user based on compliance of the first user with the activity protocols. Additional users at other locations may also receive the first activity from the second user.
Core Innovation
A virtual or augmented reality system provides a virtual environment to a first user at a first location, and the first user interacts with the virtual environment. Positional data of the first user are collected based on the interaction, and a first activity is provided by a second user at a second location via a network and is displayed to the first user by layering the first activity over the virtual environment.
Additional data related to the first user and the first activity are collected, including positional data of the first user, and in some embodiments audio data and biometric sensor data. A compliance metric is determined based on the collected data. When the compliance metric differs from a predetermined range, a first adjustment to the first activity is applied, based on the collected data, and the adjusted first activity is displayed by layering the adjusted first activity over the virtual environment.
The virtual environment is further provided to a third user at a third location via the virtual or augmented reality system, where the third user is enabled to interact with the first user. The first activity is displayed to the third user by layering the first activity over the virtual environment, and additional data related to the third user and the first activity are collected, including positional data of the third user. A second adjustment to the first activity for the third user is applied based on the collected data.
Claims Coverage
The independent claims cover a multi-user virtual or augmented reality platform in which an activity is layered into a virtual environment and compliance is evaluated from collected positional, and in some embodiments biometric/audio, data to drive conditional adjustments. The inventive features appear across three independent claim sets: a method, a system including biometric sensors and a computing node, and a computer program product embodying the method.
Layered activity in a virtual environment for multi-location users
Providing a virtual environment to a first user via a virtual or augmented reality system at a first location; displaying a first activity to the first user by layering the first activity over the virtual environment; providing the virtual environment to a third user at a third location, wherein the third user is enabled to interact with the first user; displaying the first activity to the third user by layering the first activity over the virtual environment.
Compliance metric from positional and biometric/audio data
Collecting a first set of data based on the first user's interaction with the virtual environment, the first set of data comprising positional data of the first user; collecting a second set of data related to the first user and the first activity in the virtual environment, the second set of data comprising positional data of the first user; determining a compliance metric based on the second set of data, where in the system claim the first set and second set of data comprise audio data and positional data from one or more biometric sensors.
Conditional adjustment of the activity based on compliance metric
Providing the first set of data to a second user at a second location via a network; receiving, from the second user, a first activity; when the compliance metric differs from a predetermined range, applying a first adjustment to the first activity, the first adjustment based on the second set of data; displaying the adjusted first activity to the first user by layering the adjusted first activity over the virtual environment.
Per-third-user adjustment based on third-user collected data
Collecting a third set of data based on the third user's interaction with the virtual environment, the third set of data comprising positional data of the third user; collecting a fourth set of data related to the third user and the first activity in the virtual environment, the fourth set of data comprising positional data of the third user; applying a second adjustment to the first activity for the third user, the second adjustment based on the fourth set of data.
Biometric sensors and computing node executing the platform method
A virtual or augmented reality system comprising a virtual or augmented reality display adapted to display a virtual environment to a first user; one or more biometric sensors coupled to the first user; and a computing node with a computer readable storage medium and program instructions executable by a processor to perform the method including providing the virtual environment, collecting audio and positional data from the biometric sensors, sending data to a second user via a network, layering and displaying the first activity, determining a compliance metric, and applying first and second adjustments as compliance differs from the predetermined range.
Across the independent claims, the platform centers on layering a received first activity into a virtual environment for a first user and a third user at different locations, collecting positional and in some embodiments biometric/audio data, determining a compliance metric, and applying adjustments to the first activity when the compliance metric differs from a predetermined range. Adjustments are computed for the first user and separately for the third user based on their respective collected data.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?