Endoscopic video imaging system with automatic reorientation

Inventors

Hale, Eric L

Assignees

Karl Storz Imaging Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12167837-B2

Patent

Publication Date

2024-12-17

Expiration Date


Abstract

A video imaging system is provided. The video imaging system is configured to maintain a video image displayed on a display unit in a predetermined orientation based upon a use. The video imaging system includes an endoscope, a camera head unit, a camera control unit configured to determine a focal distance, and a display control unit. The display control unit is configured to process the focal distance to determine a use. The use is processed by the display control unit so as to maintain the video image in the predetermined orientation. The contextual information may be focal distance, image data or endoscopic orientation.

Core Innovation

The invention relates to an endoscopic video imaging system that automatically maintains a displayed video image in a predetermined orientation during use. The system includes an endoscope, an image sensor configured to gather an image light from the endoscope, and a display control unit that adjusts the rotation of a view orientation displayed on the display so that the video image is displayed in a predetermined orientation.

A focal distance processor in the display control unit determines a use of the endoscope as a surgical use or a non-surgical use based on a focal distance determined by the focal distance processor. During the identified use, the display control unit rotates or levels the displayed view orientation accordingly to maintain the predetermined orientation. In some examples, an orientation unit contributes acceleration and/or gravitational relationship data to support determining and adjusting the displayed view orientation.

For surgical use, the system can use a database with stored surgical procedures and contextual information to identify an ongoing procedure and maintain correct orientation. Contextual information can include image data, device/tool identification, and ranges for endoscopic orientation, as well as predetermined video image orientations associated with surgical procedures. The system can accept input for selecting a surgical procedure and a second input for adjusting orientation; a neural network can compare a selected surgical procedure with a determined surgical procedure and update database contextual information when the selected and determined procedures differ.

Claims Coverage

The independent claim includes 1 inventive concept: determining endoscope use as surgical or non-surgical from focal distance, and adjusting rotation of a displayed view orientation to maintain a predetermined video image orientation during that use. Dependent claims refine the inventive concept by specifying sensor placement, adding contextual information and orientation ranges, optionally using accelerometer/gyroscope data, adding database-driven surgical procedure selection, and adding neural-network processing for contextual information updates.

Use determination from focal distance to drive predetermined orientation display

A display control unit configured to determine, based on a focal distance determined by a focal distance processor, a use of the endoscope, the use being a surgical use or a non-surgical use, and wherein the display control unit is further configured to adjust the rotation of a view orientation displayed on the display, such that a video image is displayed on the display in a predetermined orientation during the use.

Image sensor comprised within the endoscope or the camera head unit

An image sensor configured to gather an image light from the endoscope and being comprised within either of the endoscope or the camera head unit.

Orientation context information collection for endoscopic orientation

An orientation unit configured to gather contextual information including endoscopic image data and ranges for endoscopic orientation to be transmitted to and processed by the display control unit for endoscopic orientation.

Accelerometer and/or gyroscope-based orientation data

An orientation unit with an accelerometer and/or a gyroscope that transmits detected acceleration and/or gravitational data to a display control unit.

Database-driven surgical procedure selection via user input

An input configured to let a user select one surgical procedure from a plurality stored in a database.

Neural network updating database contextual information when selected differs from determined

A neural network to process an input-selected surgical procedure, using a determined surgical procedure, and updating database contextual information with gathered contextual information when the determined procedure differs from the selected procedure.

Across the independent and dependent claims, the core coverage is the automated maintenance of a predetermined displayed view orientation by determining surgical versus non-surgical use from focal distance and adjusting display rotation during use, with refinements that add contextual endoscopic information, optional accelerometer/gyroscope data, and database-driven procedure selection and neural-network-based contextual information updates.

Stated Advantages

Automatically maintains a video image in a predetermined orientation during use.

Adjusts rotation of a view orientation based on determining use as surgical or non-surgical from focal distance.

Maintains correct orientation during surgical use by identifying an ongoing procedure using database-stored surgical procedures and contextual information.

Uses neural network processing to update database contextual information when a selected surgical procedure differs from a determined surgical procedure.

Documented Applications

Surgical and non-surgical endoscope video viewing where the system maintains the displayed view orientation in a predetermined orientation.

Surgical scenarios such as hand-off between nurse and surgeon and focus-distance changes where upright maintenance and procedure-specific leveling are illustrated.

Surgical procedure examples involving meniscus repair orientations and labrum medical device/implant orientation ranges.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.