Method and apparatus of sharpening of gastrointestinal images based on depth information
Inventors
Wang, Kang-Huai • Wilson, Gordon C • Wu, Chenyu
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-11354783-B2
Publication Date
2022-06-07
Expiration Date
Abstract
A method and apparatus for sharpening gastrointestinal (GI) images are disclosed. A target distance between the target region and the imaging apparatus is determined for a target region in the regular image. One or more filter parameters of a de-blurring filter are selected from stored filter parameters according to the target distance. A processed target region is generated by applying the de-blurring filter to the target region to improve sharpness of the target region. A method for characterizing an imaging apparatus is also disclosed. The imaging apparatus is placed under a controlled environment. Test pictures for one or more test patterns are captured at multiple test distances in a range including a focus distance using the imaging apparatus. One or more parameters associated a target point spread function are determined from each test picture for characterizing image formation of the imaging apparatus at the selected distance.
Core Innovation
A method for processing gastrointestinal (GI) images receives a regular image captured using an imaging apparatus by projecting non-structured light onto a body lumen while the imaging apparatus is in the body lumen. The method determines a target distance for a target region in the regular image, where the target distance is between the target region and the imaging apparatus, and determines one or more filter parameters of a de-blurring filter from stored test pictures or from stored filter parameters according to the target distance.
The method generates a first processed target region by applying the de-blurring filter to the target region to improve sharpness of the target region. The method provides a first processed regular image comprising the first processed target region, and in embodiments structured-light images are received in addition to the regular image, with the target distance determined using the structured-light images.
De-blurring can use a Wiener filter, where the de-blurring filter uses a camera-system point spread function (PSF) and camera-system noise. Further embodiments support distance-dependent or depth-dependent image formation and deconvolution models, where kernels and filter parameters depend on distance, depth, and optionally pixel location.
Another core aspect characterizes an individual imaging apparatus by placing it under a controlled environment and capturing test pictures for one or more test patterns at multiple test distances in a range including a focus distance. The method stores the test pictures or parameters of a de-blurring filter at the multiple test distances, where the de-blurring filter corresponds to a point-spread function characterizing image formation of the individual imaging apparatus at the selected test distance.
Claims Coverage
The provided independent claims are clm-00001, clm-00022, clm-00024, and clm-00030, and they share four core inventive features: receiving a regular GI image captured with non-structured light, determining a target distance for a target region, determining de-blurring filter parameters from stored test pictures or stored filter parameters according to the target distance, and applying the de-blurring filter or storing characterization parameters for later processing.
Distance-based de-blurring for GI image sharpness
receiving a regular image captured using an imaging apparatus by projecting non-structured light onto a body lumen when the imaging apparatus is in the body lumen; determining a target distance for a target region in the regular image, wherein the target distance is between the target region and the imaging apparatus; determining one or more filter parameters of a de-blurring filter from stored test pictures or from stored filter parameters according to the target distance; generating a first processed target region by applying the de-blurring filter to the target region to improve sharpness of the target region; and providing a first processed regular image comprising the first processed target region.
Distance-based de-blurring apparatus for GI images
receive a regular image, wherein the regular image is captured using an imaging apparatus by projecting non-structured light onto a body lumen when the imaging apparatus is in the body lumen; determine a target distance for a target region in the regular image, wherein the target distance is between the target region and the imaging apparatus; determine one or more filter parameters of a de-blurring filter from stored test pictures or from stored filter parameters according to the target distance; generate a first processed target region by applying the de-blurring filter to the target region to improve sharpness of the target region; and provide a first processed regular image comprising the first processed target region.
Characterizing an individual imaging apparatus with multi-distance de-blurring parameters
placing the individual imaging apparatus under a controlled environment; capturing test pictures for one or more test patterns at multiple test distances in a range including a focus distance using the individual imaging apparatus; and storing the test pictures or one or more parameters of a de-blurring filter associated with the individual imaging apparatus at said multiple test distances for processing images captured subsequently, wherein said one or more parameters of the de-blurring filter are derived from the test pictures at each test distance and the de-blurring filter corresponds to a point-spread function characterizing image formation of the individual imaging apparatus at the selected test distance.
Apparatus for characterizing an individual imaging apparatus with multi-distance de-blurring parameters
place the individual imaging apparatus under a controlled environment; capture test pictures for one or more test patterns at multiple test distances in a range including a focus distance using the individual imaging apparatus; and store the test pictures or one or more parameters of a de-blurring filter associated with the individual imaging apparatus at said multiple test distances for processing images captured subsequently, wherein said one or more parameters of the de-blurring filter are derived from the test pictures at each test distance and the de-blurring filter corresponds to a point-spread function characterizing image formation of the individual imaging apparatus at the selected test distance.
Across the independent claims, the patent covers distance-based de-blurring of GI images using parameters derived from stored test pictures or stored filter parameters according to a target distance, and characterization of an individual imaging apparatus by capturing test pictures at multiple test distances and storing test pictures or de-blurring filter parameters for subsequent processing.
Stated Advantages
Improve sharpness of the target region.
Documented Applications
Processing gastrointestinal (GI) images captured with an imaging apparatus projecting non-structured light onto a body lumen, including providing a processed regular image with an improved-sharpness target region.
Characterizing an individual imaging apparatus using test pictures at multiple test distances so that stored test pictures or parameters of a de-blurring filter can be used for processing images captured subsequently.
Interested in licensing this patent?