Viewing system for use in a surgical environment
Inventors
ESPOSITO, Jennifer Miglionico • GARCIA, Daniel Andrew • TAMAYO, Manuela • Shironoshita, Emilio Patrick • Lundmark, David Charles
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12472007-B2
Publication Date
2025-11-18
Expiration Date
Abstract
The invention relates to a viewing system for use in a surgical environment. Various real object detection devices detect locations of real objects in a real environment, such as a patient and body part of patient, medical staff, robots, a cutting tool on a robot, implant transferred by robot into body part, surgical tools, and disposable items. A map generator generates a map that forms a digital representation or a digital twin of the real environment. Various guiding modules including a room setup module, an anatomy registration module, a surgical planning module, and a surgical execution module make use of the digital representation to guide virtual or real objects based on the digital representation.
Core Innovation
The invention provides a viewing method that uses real object detection to detect locations of real objects in a real environment, where the real objects include at least objects that make up a layout of a room. A map generator connected to the real object detection device creates a map that forms a digital representation of the real environment including the real objects represented by at least the room-layout objects. The map is stored on a data store using a map storing routine.
A guiding module retrieves the stored map from the data store and guides at least one of a virtual object and a real object based on the digital representation. The guiding module includes a room setup module executable by the processor that sets the room up based on the digital representation by storing a desired room layout and providing an output that superimposes the desired room layout digitally relative to the real environment.
The disclosed concept further encompasses guiding modes that include anatomy registration and probe-tip localization from the digital representation, and surgical planning using a surgical planning module that displays a digital representation of a patient body part with a virtual object, receives user input to guide the virtual object, and plans surgery by moving the virtual object relative to the digital representation. The disclosure also includes map localization using coordinate-defined anchors and anchor matching between maps.
In addition, the invention includes head-mountable augmented display and tracking-oriented rendering by using a head-mountable frame on a viewer’s head to generate patterned light based on image data, guide the patterned light via a light wave guide to a retina of an eye, and present an augmented rendering of an external real object surface including a rendering of a target point.
Claims Coverage
The claims coverage identifies 3 inventive features.
Digital map creation of a real environment including room-layout objects
Detecting, with a real object detection device, locations of real objects in a real environment, including at least objects that make up a layout of a room; and executing, with a processor, a map generator connected to the real object detection device to receive data of the real environment and create a map that forms a digital representation of the real environment including the room-layout objects.
Storing and retrieving the digital representation for guidance
Executing, with the processor, a map storing routine to store the map on the data store; and executing, with the processor, a guiding module connected to the data store to retrieve the map and guide at least one of a virtual object and a real object based on the digital representation.
Room setup module with desired layout superimposition
The guiding module is a room setup module executable by the processor to set the room up based on the digital representation, including storing a desired room layout and providing an output that superimposes the desired room layout digitally relative to the real environment.
The inventive features center on creating a digital representation of a real environment, storing and retrieving that representation for guidance, and using a room setup module to superimpose a desired room layout digitally relative to the real environment.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?