Procedure guidance and training apparatus, methods and systems
Inventors
Stone, Nelson • Griffith, Steven • Stone, Jonathan
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12106678-B2
Publication Date
2024-10-01
Expiration Date
Abstract
Procedure training apparatus, methods and systems which in one embodiment allow surgical trainees to receive expert clinical guidance during live surgery or to practice surgical skills on anatomical models in a realistic manner with an augmented reality headset which is in audio and visual communication with a remotely located trainer having a similar AR headset. A unique feature of the system includes providing live or static imaging of the surgical site to the AR headsets of the trainee and trainer wherein the imaging is provided from medical or other devices (e.g., ultrasound) through a device(s) media hub. The images are displayed in the field of view of the surgeon so that they may see their hands, the patient (or model) and the imaging simultaneously. Controls allow the imaging on the respective AR headsets to be switched on command typically by the trainer which allows the trainer to deliver the trainer's surgical site image (e.g., on their own model) to the AR headset of the trainee to illustrate correct procedure, for example. Once the trainee views the trainer's imaging of correct procedure, the imaging source may be switched back to the trainee's surgical site so that they may continue the procedure. Instruction or live clinical support during surgical procedures allow procedures to be recorded and recordings segregated by machine learning model and class, allowing for semi-supervised and/or unsupervised learning. After machine learning models are created, automated guidance and/or alerts may be given during the surgical procedure.
Core Innovation
The invention provides communication between a trainee and a remote trainer of a procedure using first and second headsets wearable by the trainee and the remote trainer, respectively. Each headset includes a viewing pane that simultaneously allows visualization of at least two non-overlapping viewing fields concurrently, including a first viewing field that displays a first image received by the headset as a first electronic signal in a first mode and allows the wearer to see a live procedure field located adjacent the wearer in a second mode.
A second viewing field adjacent to the first viewing field displays a second image received by the headset as a second electronic signal. The system further includes first and second device connection hubs connected to the first and second headsets, respectively, where each hub is operable to receive an image from at least one imaging device, and a software program having telecommunication operability and accessible by each headset projects the image into the second viewing field.
In related embodiments, the system uses an AR headset with a viewing pane and software program that allow visualization by the wearer of at least two non-overlapping viewing fields concurrently during a procedure. The software program projects an image into a second viewing field while a see-through lens provides a first viewing field that changes between displaying a first image as a first electronic signal in a first mode and allowing the wearer to see a live procedure field in a second mode, with a device connection hub connected to the headset receiving images from at least one imaging device.
Claims Coverage
The document includes two independent claims. Across them, the core inventive coverage centers on an AR headset that concurrently presents two non-overlapping adjacent viewing fields in a single viewing pane, where one field alternates between a see-through live procedure field and a received image, while a second field projects an image received via a device connection hub under telecommunication operability.
Two adjacent non-overlapping viewing fields in a viewing pane with mode switching
A first and second headsets wearable by the trainee and remote trainer, respectively, each having a viewing pane operable to simultaneously allow visualization of at least two non-overlapping viewing fields concurrently, where a first viewing field is a see-through lens configured to display a first image received by the headset as a first electronic signal in a first mode and allow the wearer to see a live procedure field located adjacent the wearer in a second mode, and where a second viewing field adjacent to the first field displays a second image received by the headset as a second electronic signal.
Device connection hubs that receive images from imaging devices
First and second device connection hubs connected to said first and second headsets, respectively, each operable to receive an image from at least one imaging device.
Telecommunication software projecting received images into a second viewing field
A software program having telecommunication operability and accessible by each said first and second headsets and operable to project said image in said second viewing field.
AR headset and device connection hub for concurrent viewing during a procedure
An AR headset having a viewing pane and software program operable to allow visualization by the wearer of at least two non-overlapping viewing fields concurrently, where the first viewing field is a see-through lens configured to display a first image received by the headset as a first electronic signal in a first mode and allow the wearer to see a live procedure field located adjacent the wearer in a second mode and a second viewing field adjacent to the first field displaying a second image received by the headset as a second electronic signal; and a device connection hub connected to said headset, said hub operable to receive an image from at least one imaging device; and said software program operable to project said image in said second viewing field.
The independent claims broadly cover a telecommunication-enabled system for procedure support in which an AR headset concurrently displays adjacent non-overlapping viewing fields: a see-through live procedure field in a mode and an additional projected image in another field. Images are received through device connection hubs from at least one imaging device, and software projects the received image(s) into the second viewing field.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?