Medical training systems and methods
Inventors
TUCHSCHMID, STEFAN • BACHOFEN, DANIEL • HARDERS, MATTHIAS • SPILLMAN, JONAS
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-9142145-B2
Publication Date
2015-09-22
Expiration Date
Abstract
Simulation systems and methods may enable virtual imaging. A data processing unit may receive data from a calibration unit indicating a position and/or orientation of a position and orientation sensor relative to a physical model. The data processing unit may also receive data from the position and orientation sensor indicating a position and/or orientation of the physical model. The data processing unit may generate a virtual image using the data from the position and orientation sensor and the data from the calibration unit. The data processing unit may render the virtual image to a display.
Core Innovation
The invention relates to a simulation system for medical training that includes a data processing unit and a display, together with a physical model comprising an endoscopy training model and a tool. A position and orientation sensor senses the position and/or orientation of the physical model, and a calibration unit stores calibration data associated with the position and orientation sensor and the physical model. The data processing unit identifies the physical model based on the calibration data and proposes a choice of simulation scenarios based on the identification, where each simulation scenario comprises a virtual reality (VR) model or an augmented reality (AR) model.
After a user selects one of the simulation scenarios, the data processing unit receives data from the position and orientation sensor indicating the position of the physical model, the orientation of the physical model, or a combination thereof. The data processing unit also receives the calibration data from the calibration unit indicating the position of the position and orientation sensor relative to the physical model, the orientation of the position and orientation sensor relative to the physical model, or a combination thereof. The data processing unit generates the VR model or AR model associated with the selected simulation scenario using the data from the position and orientation sensor and the calibration data, and renders the VR model or AR model to the display.
In one implementation, the simulation system proposes and displays matching training scenarios based on the identification of the physical model, and supports use of a plurality of position and orientation sensors to track the physical model. The system can weight sensor data based on sensor reliability to address drift and instability due to magnetic distortion associated with multi-sensor relative/over-defined sensing. In addition, tool-level sensing and calibration can be used to generate and render a tool virtual image, using a tool position and orientation sensor and tool calibration data.
Claims Coverage
The partial content includes two independent claims that cover both a simulation system and a corresponding simulation method. Across the independent claims, the core inventive structure is organized around identifying a physical endoscopy training model via stored calibration data, selecting a VR/AR simulation scenario, generating a VR/AR model using sensor data and calibration data, and rendering the result to a display, with optional refinements in dependent claims for multi-sensor reliability handling and tool virtual image generation.
Simulation system with calibration-based physical model identification and scenario-driven VR/AR rendering
A simulation system comprising a data processing unit, a display, a physical endoscopy training model and a tool, a position and orientation sensor for the physical model, and a calibration unit storing calibration data associated with the position and orientation sensor and the physical model, where the data processing unit identifies the physical model based on the calibration data and proposes a choice of simulation scenarios comprising a VR model or an AR model, receives a user selection of one simulation scenario, receives position and/or orientation data from the position and orientation sensor, receives the calibration data, generates the VR model or AR model associated with the selected simulation scenario using the sensor data and calibration data, and renders the VR model or AR model to the display.
Simulation method with calibration-based physical model identification and scenario-driven VR/AR rendering
A simulation method comprising receiving, with a data processing unit, calibration data indicating a position of a position and orientation sensor relative to a physical model, an orientation of the position and orientation sensor relative to the physical model, or a combination thereof, wherein the physical model comprises an endoscopy training model, a tool, the position and orientation sensor, and the calibration unit; identifying the physical model based on the calibration data and proposing a choice of simulation scenarios comprising a VR model or an AR model; receiving a selection of one simulation scenario from a user; receiving data from the position and orientation sensor indicating a position of the physical model, an orientation of the physical model, or a combination thereof; generating the VR model or AR model associated with the selected simulation scenario using the sensor data and the calibration data; and rendering the VR model or AR model to a display.
Overall, the independent claim coverage centers on calibration data and position/orientation sensor data for identifying a physical endoscopy training model, proposing and selecting simulation scenarios, generating an associated VR or AR model from the selected scenario, and rendering that VR/AR model to a display.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Medical training using VR/AR simulation scenarios for an endoscopy training model, including endoscopy training involving an endoscopy training model and a tool.
Interested in licensing this patent?