Equipment detection using a wearable device
Inventors
Wallack, Jacob • Murphy, Robert • Lind, Jonathan
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12429947-B2
Publication Date
2025-09-30
Expiration Date
Abstract
A simulation system may comprise a headset and an equipment. A wireless communication interface of the headset may receive position information from the equipment. The headset may detect a passively-instrumented object represented in a captured image. The headset may detect a wearable device coupled to the passively-instrumented object. The headset may determine position information for the passively-instrumented object. The headset may present an image of virtual equipment corresponding to the equipment in accordance with the position information from the equipment and the position information detected for the passively-instrumented object.
Core Innovation
The invention provides a virtual reality-based training simulation system that detects equipment without relying on external sensors. A wearable computing device receives equipment position information from the equipment via a wireless network interface, captures an image, and determines a position of a passively-instrumented object relative to the wearable computing device in accordance with the captured image.
The determined position is used to display an image of the equipment aligned with the position of the passively-instrumented object. Determining the position of the passively-instrumented object includes determining a position of a wearable device coupled to the passively-instrumented object and detecting the wearable device in the captured image, including a wristband coupled to the passively-instrumented object.
The invention supports configuration-driven identification of which passively-instrumented object to use and includes anchor-point assumptions and pose/gesture inference to support position determination and display alignment. The system architecture includes a headset or wearable device, an equipment unit that provides position information, wearable modules for object detection and equipment-position detection, and an optional server or trainer for simulation control. Optional status information such as safety or activation can be rendered with the virtual equipment and virtual object imagery.
Claims Coverage
The provided independent claims cover a VR-based training detection method, a corresponding simulation system, and non-transitory computer-readable storage media. Across the independent claims, three inventive features are central: receiving equipment position information wirelessly, determining a relative position of a passively-instrumented object from a captured forward-facing image by detecting a coupled wearable device, and displaying an image of the equipment aligned to that position using the received equipment position information.
Wireless equipment position information reception for VR detection
receiving, via a wireless network interface of a wearable computing device, equipment position information from the equipment
Image-based determination of passively-instrumented object position
determining a position of a passively-instrumented object relative to the wearable computing device in accordance with a captured image
Coupled wearable device position determination by detecting the wearable device in the captured image
determining the position of the passively-instrumented object comprises determining a position of a wearable device coupled to the passively-instrumented object, including detecting the wristband coupled to the passively-instrumented object in the captured image
Display of equipment image based on passively-instrumented object position and equipment position information
displaying, via a display of the wearable computing device, an image of the equipment in accordance with the position of the passively-instrumented object and the equipment position information
Forward facing image capture from a headset
capturing, via at least one camera of the wearable computing device, an image in a forward facing direction from a headset of the wearable computing device
Across the independent claims, the invention ties together wireless reception of equipment position information with image-based determination of a passively-instrumented object position via detecting a coupled wearable device. The system then displays an image of the equipment in accordance with that inferred object position and the received equipment position information, including forward-facing image capture from the wearable headset.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?