Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
An endoscope system includes: an endoscope; a moving device that holds and moves the endoscope; and at least one processor. The at least one processor is configured to: detect a movement direction of the endoscope moved by the moving device in a coordinate system of the moving device; estimate an area of a moving body in an image captured by the endoscope; detect a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body; calculate a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object; and correct the coordinate system of the moving device on the basis of the deviation.
Core Innovation
The invention relates to an endoscope system and a coordinate system correction in which at least one processor detects a movement direction of an endoscope moved by a moving device in a coordinate system of the moving device. The processor estimates an area of a moving body in an image captured by the endoscope and detects a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body.
Based on the detected movement direction of the endoscope and the detected movement direction of the object, the processor calculates a deviation between a coordinate system of the endoscope and the coordinate system of the moving device. The processor corrects the coordinate system of the moving device on the basis of the calculated deviation.
Embodiments further detect object movement direction on the basis of an image area excluding an area in which magnitudes of motion vectors are greater than or equal to a predetermined threshold, and using another area that excludes an area obtained by adding a margin to the moving body area. Additional embodiments include an oblique-viewing endoscope in which rotation about a longitudinal axis is derived for deviation, and stereo imaging and three-dimensional position/orientation estimation are used to support coordinate-system rotation determination.
Claims Coverage
The partial content includes two independent claim sets covering an endoscope system with coordinate system correction and a coordinate system correction method. Across the independent claims, three core inventive themes appear: detecting endoscope movement direction in the moving-device coordinate system, detecting object movement direction using image regions excluding the moving-body area, and computing a deviation between coordinate systems from both movement directions to correct the moving-device coordinate system.
Movement direction detection in moving-device coordinate system
Detect a movement direction of the endoscope moved by the moving device in a coordinate system of the moving device.
Moving-body area estimation in endoscope image
Estimate an area of a moving body in an image captured by the endoscope.
Object movement detection excluding the moving-body area
Detect a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body.
Deviation-based coordinate system correction
Calculate a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object, and correct the coordinate system of the moving device on the basis of the calculated deviation.
Motion-vector estimation with thresholded exclusion region
Estimate motion vectors at respective positions in an image captured by the endoscope; detect a movement direction of an object in the image on the basis of another area in the image excluding an area in which magnitudes of the motion vectors are greater than or equal to a predetermined threshold.
Coordinate system correction method for a moving endoscope held by a moving device
Detect a movement direction of the endoscope moved by the moving device in the coordinate system of the moving device; estimate an area of a moving body in an image captured by the endoscope; detect a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body; calculate a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object; and correct the coordinate system of the moving device on the basis of the calculated deviation.
Overall, the independent claims cover an endoscope system and a coordinate system correction method in which endoscope motion and object movement are used to calculate a deviation between the endoscope coordinate system and the moving-device coordinate system, and the moving-device coordinate system is corrected based on that deviation.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?