Method of alerting a user to off-screen events during surgery

Inventors

Nir, Tal • PFEFFER, Yehuda

Assignees

Asensus Surgical Europe SARL

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12408823-B2

Patent

Publication Date

2025-09-09

Expiration Date


Abstract

An image of a field of view is captured by the endoscope and a portion of the image is displayed on a display. A popup image is generated and displayed upon image analysis identification of an occurrence of bleeding or motion of edges of an incision that is within the field of view, but outside the portion of the field of view displayed on the display.

Core Innovation

The invention provides an endoscopic system and method for alerting a user to events during surgery by digitally maneuvering a captured wide-angle field of view without physically moving the endoscope or optics. The system positions an endoscope in a body cavity and captures images of the body cavity using the endoscope having a field of view. A portion of the field of view is selected and displayed on a display as the displayed portion of the field of view.

In real time, the system analyzes the images to identify a change of state of a tool disposed within the field of view but outside the portion of the field of view. The change of state is at least one of articulation of the tool, activation of the tool, or deactivation of the tool. When the image analysis identifies the change of state, the system displays an overlay on the portion of the field of view displayed on the display.

The overlay is positioned to indicate a location of the tool relative to the portion of the field of view that is displayed. The disclosed approach supports identifying off-screen events within the lens field of view and communicating the event location through a popup or warning overlay. The disclosure further includes configurable digital zoom modes, optional physical maneuvering combined with digital maneuvering, controllable illumination, multi-camera image combining, discrete or continuous view switching, and a database of stored view positions, together with warning and response interfaces.

Claims Coverage

The provided independent claim covers an alerting method with 3 core inventive aspects: selection and display of a portion of the field of view, real-time identification of a tool change of state outside the displayed portion, and overlay positioning that indicates tool location relative to the displayed portion.

Selecting and displaying a portion of the endoscope field of view

Selecting a portion of said field of view and displaying said portion of the field of view on the display.

Real-time identifying tool change of state outside the displayed portion

Analyzing, in real time, the images to identify a change of state of a tool disposed within the field of view but outside the portion of the field of view, said change of state being at least one of articulation of the tool, activation of the tool or deactivation of the tool.

Overlay indicating tool location relative to the displayed portion

Upon image analysis identification of said change of state of a tool disposed within the field of view but outside the portion of the field of view, displaying an overlay on the portion of the field of view displayed on the display, wherein said overlay is positioned to indicate a location of the tool relative to the portion of the field of view.

Overall, the claim coverage centers on detecting tool change-of-state events outside the displayed region using real-time image analysis, and presenting a positioned overlay on the displayed portion to indicate the tool’s location relative to that portion.

Stated Advantages

Enables alerting a user to events during surgery based on image analysis of a tool change of state outside the displayed portion of the field of view.

Provides visual indication via an overlay positioned to indicate the location of the tool relative to the displayed portion.

Supports identifying tool change-of-state events including articulation, activation, and deactivation.

Documented Applications

Alerting a user to events during surgery by monitoring tools disposed within an endoscope field of view while displaying only a selected portion of the field of view.

Identifying and indicating off-screen events within the lens field of view, including bleeding and incision edge motion.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.