Method and apparatus of sharpening of gastrointestinal images based on depth information
Inventors
Wang, Kang-Huai • Wilson, Gordon C. • Wu, Chenyu
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10943333-B2
Publication Date
2021-03-09
Expiration Date
Abstract
A method for sharpening gastrointestinal (GI) images and an apparatus thereof are disclosed. A first target distance between a first target region in a regular image and an imaging apparatus is determined, and a second target distance between a second target region in the regular image and the imaging apparatus is determined. One or more first filter parameters for a first de-blurring filter and one or more second filter parameters for a second de-blurring filter are selected from stored filter parameters according to the first and second target distances respectively. A first processed target region is generated by applying the first de-blurring filter to the first target region to improve sharpness of the first target region. A second processed target region is generated by applying the second de-blurring filter to the second target region to improve sharpness of the second target region.
Core Innovation
A method for processing gastrointestinal (GI) images receives a regular image captured using an imaging apparatus by projecting non-structured light onto a body lumen when the imaging apparatus is in the body lumen. The method determines a first target distance for a first target region in the regular image and selects one or more first filter parameters for a first de-blurring filter from stored filter parameters according to the first target distance. The method generates a first processed target region by applying the first de-blurring filter to the first target region to improve sharpness, and repeats this for at least a second target region.
The method determines a second target distance for a second target region in the regular image and selects one or more second filter parameters for a second de-blurring filter from the stored filter parameters according to the second target distance. The method generates a second processed target region by applying the second de-blurring filter to the second target region to improve sharpness. The method provides a processed regular image comprising the first processed target region and the second processed target region.
The disclosure also characterizes an imaging apparatus by placing the imaging apparatus under a controlled environment and capturing test pictures for a set of pre-defined patterns at multiple test distances in a range including a focus distance using projected light. From each test picture, one or more parameters associated with a target point spread function are determined, where the target point spread function characterizes image formation of the imaging apparatus at the selected distance. The method stores a set of parameters associated with a set of point spread functions characterizing image formation at the multiple test distances for processing images captured subsequently.
Claims Coverage
The document includes four independent claims that collectively cover region-dependent de-blurring/deconvolution for GI images and the prior characterization and storage of imaging parameters via target point spread functions across multiple distances.
Region-dependent de-blurring for GI images using target distances
Receiving a regular image captured by projecting non-structured light onto a body lumen; determining a first target distance for a first target region and selecting one or more first filter parameters for a first de-blurring filter from stored filter parameters according to the first target distance; applying the first de-blurring filter to the first target region to improve sharpness; repeating for a second target region with a second target distance and a second de-blurring filter; providing a processed regular image comprising the processed target regions.
GI image processing apparatus using target distances and stored filter parameters
An apparatus with a processor configured to receive a regular image captured by projecting non-structured light onto a body lumen; determine a first target distance for a first target region and select one or more first filter parameters for a first de-blurring filter from stored filter parameters according to the first target distance; generate a first processed target region by applying the first de-blurring filter to improve sharpness; determine a second target distance for a second target region and select one or more second filter parameters for a second de-blurring filter from the stored filter parameters according to the second target distance; generate a second processed target region by applying the second de-blurring filter to improve sharpness; provide a processed regular image comprising the processed target regions.
Characterizing an imaging apparatus by storing target point spread function parameters across distances
Placing the imaging apparatus under a controlled environment; capturing test pictures for a set of pre-defined patterns at multiple test distances in a range including a focus distance; determining one or more parameters associated with a target point spread function from each test picture, where the target point spread function characterizes image formation at the selected distance; storing a set of the parameters associated with a set of point spread functions characterizing image formation at the multiple test distances for processing subsequently captured images.
Characterizing an individual imaging apparatus by storing target point spread function parameters across distances
Placing the individual imaging apparatus under a controlled environment; capturing test pictures for a set of pre-defined patterns at multiple test distances in a range including a focus distance; determining one or more parameters associated with a target point spread function from each test picture, where the target point spread function characterizes image formation of the individual imaging apparatus at the selected distance; storing a set of the parameters associated with a set of point spread functions characterizing image formation at the multiple test distances for processing images captured subsequently.
Across independent claims, the core coverage combines region-specific target-distance-based selection of stored de-blurring filter parameters to improve sharpness in a processed GI image and generation and storage of imaging-formation parameters using a target point spread function characterized from test pictures captured across multiple test distances including a focus distance.
Stated Advantages
Improves sharpness of the first target region.
Improves sharpness of the second target region.
Documented Applications
Processing gastrointestinal (GI) images captured by projecting non-structured light onto a body lumen using an imaging apparatus in the body lumen.
Processing subsequently captured images using stored point spread function parameters obtained from characterizing an imaging apparatus across multiple test distances including a focus distance.
Interested in licensing this patent?