Surgical virtual reality user interface
Inventors
Bail, Jeffrey • Sachs, Adam • Antinori, Maxim
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12329588-B2
Publication Date
2025-06-17
Expiration Date
Abstract
A surgical virtual reality user interface generating system can comprise a sensor and tracking unit for sensing and tracking a position of a portion of a user and generating position data based on movement of the user, a computing unit for receiving and processing the position data and generating control signals. The system can also include a surgical robot system for receiving the control signals and having a camera assembly for generating image data, and a virtual reality computing unit for generating a virtual reality world. The virtual reality computing unit can include a virtual reality rendering unit for generating an output rendering signal for rendering the image data, and a virtual reality object generating unit for generating virtual reality informational objects and emplacing the informational objects in the virtual reality world. A display unit can display the virtual reality world and the informational objects to the user.
Core Innovation
A surgical virtual reality user interface generating system senses and tracks a position of a portion of a user in space and generates position data based on movement of the user. A computing unit receives the position data, processes it, and generates control signals in response to the processed position data, and the system couples these control signals to a surgical robot system having a camera assembly with a pair of axially spaced apart cameras configured to generate image data.
A virtual reality computing unit generates a virtual reality world and includes a virtual reality rendering unit and a virtual reality object generating unit. The virtual reality rendering unit receives at least the image data from the camera assembly and generates an output rendering signal for rendering the image data for display. The virtual reality object generating unit generates one or more virtual reality informational objects and generates a docking station configured to include a plurality of slots, each configured to house at least one informational object.
The system emplaces at least one of the one or more virtual reality informational objects in the docking station or removes at least one informational object from the docking station. The display unit displays the virtual reality world including the docking station, the one or more virtual reality informational objects, and the image data from the output rendering signal to the user. Interaction rules further specify informational-object mode switching and presentation modes tied to the docking station and user, including free mode, docking mode, and attached mode.
Claims Coverage
The document includes two independent claims: an apparatus/system claim and a method claim. The claims center on a tracked user position driving control signals for a surgical robot camera assembly, and on rendering a virtual reality world that includes virtual informational objects managed through a docking station with slots.
Tracking a user portion and generating control signals for a surgical robot
A sensor and tracking unit senses and tracks a position of a portion of a user in space and generates at least position data based on movement of the user; a computing unit receives the position data, processes it, and generates control signals in response to the processed position data.
Surgical robot camera assembly with axially spaced cameras for image data
A surgical robot system coupled to the computing unit receives the control signals and has a camera assembly having a pair of axially spaced apart cameras for generating image data.
Rendering a virtual reality world with informational objects and a docking station of slots
A virtual reality computing unit generates a virtual reality world including a virtual reality rendering unit that receives at least the image data and generates an output rendering signal for rendering for display, and a virtual reality object generating unit that generates one or more virtual reality informational objects and a docking station configured to include a plurality of slots each configured to house at least one of the one or more virtual reality informational objects.
Emplacing and removing informational objects in the docking station for display
The system emplaces at least one of the one or more virtual reality informational objects in the docking station or removes at least one of the one or more virtual reality informational objects from the docking station, and the display unit displays the virtual reality world including the docking station, the one or more virtual reality informational objects, and the image data from the output rendering signal to the user.
Method generating informational objects using tracked user position and surgical robot camera image data
A method of generating one or more informational objects comprising sensing and tracking at least a position of a portion of a user in space to generate position data, providing a computing unit that receives and processes the position data and generates control signals, and providing a surgical robot system for receiving the control signals and having a camera assembly with a pair of axially spaced apart cameras for generating image data.
Rendering and displaying a virtual reality world with docking station slots and informational objects
Generating a virtual reality world with a virtual reality computing unit that includes a virtual reality rendering unit generating an output rendering signal and a virtual reality object generating unit generating one or more virtual reality informational objects and a docking station configured to include a plurality of slots each configured to house at least one informational object.
Emplacing and removing informational objects from docking station and displaying to the user
Emplacing at least one of the one or more virtual reality informational objects in the docking station or removing at least one of the one or more virtual reality informational objects from the docking station, and displaying the virtual reality world including the docking station, the one or more virtual reality informational objects, and the image data from the output rendering signal to the user.
The inventive coverage combines a tracked user-position-to-control-signal pipeline coupled to a surgical robot with a dual axially spaced camera assembly, together with VR rendering of a virtual reality world that includes one or more virtual reality informational objects managed via a docking station having a plurality of slots, with object emplacing and removal and display of both objects and robot image data.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?