Methods and systems for generating three-dimensional images that enable improved visualization and interaction with objects in the three-dimensional images
Inventors
Sivakumar, Mala • Brown, Thomas • Krishnan, Karthik
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-11594001-B2
Publication Date
2023-02-28
Expiration Date
Abstract
In some embodiments, the present specification describes methods for displaying a three-dimensional image of an isolated threat object or region of interest with a single touch or click and providing spatial and contextual information relative to the object, while also executing a view dependent virtual cut-away or rendering occluding portions of the reconstructed image data as transparent. In some embodiments, the method includes allowing operators to associate audio comments with a scan image of an object. In some embodiments, the method also includes highlighting a plurality of voxels, which are indicative of at least one potential threat item, in a mask having a plurality of variable color intensities, where the intensities may be varied based on the potential threat items.
Core Innovation
The disclosed invention relates to scanning an object using an X-ray scanner with a scanning volume, where an object is moved through the scanning volume while the object is irradiated with X-rays generated by a plurality of X-ray sources arranged around the scanning volume. X-rays transmitted through the object are detected with a detector array positioned around the scanning volume, where the detector array comprises a plurality of multi-energy detector modules. Reconstructed image data are generated and displayed as an image on a display.
The display receives a first interaction with an area of the display that visually depicts a portion of the reconstructed image data, and in response the portion is visually isolated from a remainder of the portion. The visual isolating is performed by replacing the portion of the reconstructed image data with a transparent void having dimensions equivalent to the portion of the reconstructed image data.
Voxels of a potential threat object are identified in the voxels of the image, and the potential threat object is highlighted on the display using at least one of spatial or contextual information. The disclosed visualization further includes isolating and emphasizing the potential threat object using a view-dependent virtual cut-away with transparent rendering and/or handling occluding portions as transparent, with different optical properties assigned to the voxels of the potential threat object and guide lines aligned between the visually isolated portion and its origin context.
Claims Coverage
The document explicitly includes one independent method claim focused on X-ray scanning, reconstructed image display, interactive visual isolation of a selected image portion, identification of potential threat object voxels, and highlighting using spatial or contextual information. The described coverage is refined by dependent claims that specify transparent-void replacement, virtual cut-away and transparent occlusion handling, bounding box visualization, voxel-level optical-property differences, guide-line alignment, and touch-screen interaction.
X-ray scanning with multi-energy detector modules and reconstructed image display
Moving the object through the scanning volume; irradiating the object with X-rays generated by a plurality of X-ray sources arranged around the scanning volume; detecting X-rays transmitted through the object using a detector array positioned around the scanning volume, wherein the detector array comprises a plurality of multi-energy detector modules; generating reconstructed image data; displaying the reconstructed image data as an image on a display.
Interactive visual isolation of a display portion using transparent void replacement
Receiving a first interaction of an area of the display that visually depicts a portion of the reconstructed image data; in response to the first interaction, visually isolating the portion from a remainder of the portion; wherein the visual isolating comprises replacing the portion of the reconstructed image data with a transparent void having dimensions equivalent to the portion of the reconstructed image data.
Potential threat object voxel identification and spatial/contextual highlighting
Identifying voxels of a potential threat object in the voxels of the image of the object; and highlighting the potential threat object on the display using at least one of spatial or contextual information.
Bounding box highlighting of the potential threat object
Highlighting the potential threat object by presenting a visually perceptible bounding box in the image.
View-dependent virtual cut-away and transparent occlusion handling
Highlighting by removing reconstructed image portions that occlude a view of the potential threat object using a view-dependent virtual cut-away and rendering occluding portions as transparent.
Voxel optical-property differentiation for highlighting
Highlighting by assigning voxels of the potential threat object a first set of optical properties different from a second set of optical properties assigned to the other remaining voxels in the image.
Guide-line-based spatial alignment between isolated and contextual image portions
Using a plurality of guide lines to keep spatial alignment between a visually isolated portion and the remainder of the reconstructed image data.
Touch-screen interaction for interactive identification
Using a touch screen so that interactive identification is performed through touch operations on the touch screen.
Across the independent claim and its dependent refinements, the core coverage combines X-ray scanning with multi-energy detector modules and reconstructed image display, interactive isolation of a selected image portion using a transparent void replacement, and identification of potential threat object voxels followed by highlighting using spatial or contextual information. Dependent claim refinements specify bounding box highlighting, voxel-level optical-property changes, view-dependent virtual cut-away and transparent occlusion handling, guide-line spatial alignment, and touch-screen interaction modality.
Stated Advantages
Visually isolates a selected portion of reconstructed image data from a remainder using a transparent void.
Highlights potential threat object voxels on the display using at least one of spatial or contextual information.
Provides a visually perceptible bounding box for highlighting the potential threat object.
Handles occlusion during highlighting using view-dependent virtual cut-away and transparent occluding portions.
Emphasizes potential threat object voxels by assigning different optical properties compared with remaining voxels.
Maintains spatial alignment between the visually isolated portion and the remainder of the reconstructed image data using guide lines.
Enables interactive identification through touch screen operations.
Documented Applications
No documented applications found
Interested in licensing this patent?