Method and apparatus for image stitching of images captured using a capsule camera
Inventors
Wang, Kang-Huai • Xu, Yi • Wu, Chenyu
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10943342-B2
Publication Date
2021-03-09
Expiration Date
Abstract
A method and apparatus of processing images captured from human gastrointestinal (GI) tract by a capsule camera are disclosed. High frame-rate images captured from human gastrointestinal (GI) tract by a capsule camera are received for processing. The high frame-rate images comprise first images at a first spatial resolution corresponding to a regular frame rate and second images at a second spatial resolution, the first images and the second images are interleaved, and the second spatial resolution is lower than the first spatial resolution. Motion models among the high frame-rate images are derived by applying image registration to the high frame-rate images. The high frame-rate images are stitched according to the motion models to generate stitching outputs comprising stitched images and non-stitched images. The stitching outputs are provided.
Core Innovation
The disclosed invention relates to processing images captured from a human gastrointestinal (GI) tract by a capsule camera. High frame-rate images are received, where the high frame-rate images comprise regular images and bridging images that are interleaved, and the bridging images are captured with a lower spatial resolution than the regular images.
The invention derives motion models among the high frame-rate images based on image registration, where the image registration comprises target image registration between bridging images or between regular images and bridging images. Motion models are derived using image registration among the high frame-rate images, including target image registration between bridging images or between regular images and bridging images.
The invention stitches the high frame-rate images according to the motion models to generate stitching outputs comprising stitched images and non-stitched images, and provides the stitching outputs. The outputs can include membership information indicating partial contributions of original frames to each stitched image.
In preferred embodiments, stitching may be applied only to the regular images, and any non-stitched bridging images are dropped. Bridging images are captured using reduced spatial resolution, and may also be captured with reduced light-source energy, lower bit-depth, and/or a higher compression ratio to conserve capsule power and storage.
Claims Coverage
The independent claims cover interleaved regular and lower-spatial-resolution bridging frames from a capsule camera, registration-driven motion modeling, and stitching outputs comprising stitched images and non-stitched images, with removal of non-stitched images that belong to the bridging images. Across the independent claims, the inventive features focus on interleaved bridging frames, image registration, stitching, and output handling of non-stitched images.
Interleaved regular and lower-spatial-resolution bridging images for high frame-rate capsule GI imaging
Receiving high frame-rate images captured from human gastrointestinal (GI) tract by a capsule camera, wherein the high frame-rate images comprise regular images and bridging images, wherein the regular images and the bridging images are interleaved, and wherein the bridging images are captured with a lower spatial resolution than the regular images.
Image registration-based motion models using target image registration between bridging images or between regular and bridging images
Deriving motion models among the high-frame-rate images based on image registration, wherein the image registration comprises target image registration between bridging images or between regular images and bridging images.
Stitching high frame-rate images according to motion models to generate stitching outputs with stitched images and non-stitched images
Stitching the high frame-rate images according to the motion models to generate stitching outputs comprising stitched images and non-stitched images; and providing the stitching outputs.
Removing non-stitched images that belong to bridging images
Removing any non-stitched image from the stitching outputs if the non-stitched image belongs to the bridging images; and providing the stitching outputs.
System that receives interleaved regular/bridging capsule GI frames, derives motion models by target registration, and stitches into outputs
A system for processing images captured from human gastrointestinal (GI) tract by a capsule camera, the system comprising one or more processors arranged to receive high-frame-rate images, derive motion models based on image registration, stitch the images according to the motion models, and provide the stitching outputs.
Across the independent claims, the invention is directed to interleaved regular and lower-spatial-resolution bridging images captured from a capsule camera in the human GI tract, motion models derived via image registration using target registration between bridging and/or regular images, and stitching into stitching outputs comprising stitched images and non-stitched images, with removal of non-stitched images that belong to the bridging images.
Stated Advantages
Conserves capsule power and storage by capturing bridging images using reduced spatial resolution, reduced light-source energy, lower bit-depth, and/or higher compression ratio.
Documented Applications
Processing images captured from a human gastrointestinal (GI) tract by a capsule camera, including stitching outputs comprising stitched images and non-stitched images for provided results.
Capturing and processing images while the capsule camera travels through the human gastrointestinal (GI) tract after swallowed by a human subject, to provide stitching outputs comprising stitched images and non-stitched images.
Interested in licensing this patent?