Privacy protected image and obscuration system
Inventors
Assignees
US Department of Homeland Security
Publication Number
US-11696012-B2
Publication Date
2023-07-04
Expiration Date
2041-03-26
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
Systems and methods are disclosed and an example system includes a digital image receiver for receiving a digital image, and an automatic obscuration processor coupled to the image receiver and configured to determine whether the digital image includes a region that classifies as an image of a category of object and, upon a positive determination, to obscure the region and output a corresponding obscured-region digital image.
Core Innovation
The invention disclosed is a system and method for generating a privacy protected image by receiving a digital image, determining whether the image includes regions that classify as images of one or more categories of objects that are identity-correlated, and upon a positive determination, obscuring those regions and outputting a corresponding obscured-region digital image. This includes both still images and sequences of images, or moving picture images, and can operate on compressed or uncompressed formats.
The problem addressed arises from concerns regarding privacy in image capture devices used for public safety and security, particularly related to unauthorized access or distribution of feeds that may reveal personal identifiable information (PII). Examples include facial geometry, license plate numbers, and personal name tags. The invention aims to provide an automatic obscuration that protects privacy by detecting and obscuring identity-correlated objects in images, thereby reducing privacy risks associated with image capture devices.
Claims Coverage
The patent includes multiple independent claims covering systems and methods for privacy protected image generation. Key inventive features revolve around detection, categorization, and category-specific obscuring of identity-correlated objects.
Category-specific identity-correlated object detection and obscuring
The system includes detection logic to identify one or more identity-correlated object categories in an image and determine category instance information. The obscuring logic performs obscuration in a format with automatic category-specific selection between reversible and irreversible obscuring.
Compression coder-decoder integration for moving images
A system feature includes receiving moving picture images in compressed format, converting them to uncompressed format, applying detection and obscuring, and then recompressing the images, facilitating privacy protection in video streams.
Detection and commensurate obscuring of multiple identity-correlated regions and combinations
The system detects and categorizes multiple separate identity-correlated regions in an image and applies obscuration not only individually but also commensurately to particular combinations of identity-correlated regions which may constitute personal identification information.
Encryption-based reversible and irreversible obscuring with category-appropriate parameters
The obscuring logic includes encryption-based reversible obscuring for at least some object categories and irreversible obscuring for others, generating and providing category-specific encryption parameters for reversible processes.
Category-specific obscuring types applied to multiple instances
The system applies different obscuring types to multiple instances of different categories of identity-correlated regions, for example applying a first type to all regions of a first category and a second type to all regions of a second category, with potentially different keys per instance in reversible obscuring.
Specific object category obscuring strategies
Specific object categories, such as faces and license plates, are detected and obscured differently, e.g., faces encrypted with access-key reversible encryption and license plates irreversibly obscured by blurring.
Automatic category-based obscuration information flow
The detection logic provides object category information to the obscuring logic, which in turn provides obscuration type information to the privacy protected image output logic, facilitating automatic and appropriate obscuring.
Frame-by-frame identity-correlated object detection and obscuring in moving images
The detection and obscuring logic is configured to detect and obscure identity-correlated regions on every rth frame, generate new data for such regions, produce per-frame movement data for motion-compensated obscuring in intervening frames, and work with I, P, and B frames in compressed streams to output privacy protected moving images.
Automatic selection among different reversible and irreversible obscuring types
The system automatically selects among various reversible and irreversible obscuring types based on detected categories, including grouping categories to apply either reversible or irreversible obscuring selectively.
Overall, the claims cover a privacy protected image generation system and method with detection, category-specific obscuration—including reversible and irreversible methods—handling of compressed moving images, and flexible application of obscuring according to categories and combinations of identity-correlated objects.
Stated Advantages
Provides automatic privacy protection by detecting and obscuring identity-correlated objects in images to reduce unauthorized access to personal identifiable information.
Supports both reversible and irreversible obscuring techniques, allowing controlled access to sensitive data.
Enables efficient processing of moving images and compressed video formats by selectively applying detection and obscuring on selected frames, thus conserving computational resources.
Category-specific obscuring optimizes privacy protection tailored to different types of identity-correlated objects.
Key management features allow selective decryption of reversibly obscured regions, enhancing controlled accessibility.
Documented Applications
Privacy-aware image capture for public safety and security in various imaging spectra including visible light, infrared, and millimeter wave.
Automatic obscuring of faces, name tags, tattoos, license plate numbers, parking passes, and other personal identifiable features from images collected by video cameras or image capture devices.
Privacy protection of images in still images and moving picture images, including compressed video streams such as those encoded in H.264 and H.265 formats.
Use in integrated image capture devices with obscuration housed in secure enclosures to prevent unauthorized access.
Interested in licensing this patent?