Privacy-aware capture and device

Inventors

Vemury, Arun

Assignees

US Department of Homeland Security

Publication Number

US-11277557-B1

Publication Date

2022-03-15

Expiration Date

2041-03-26

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.


Abstract

Systems and methods are disclosed and an example system includes a digital image receiver for receiving a digital image, and an automatic obscuration processor coupled to the image receiver, and configured to determine whether the digital image includes a region that classifies as an image of a category of object and, upon a positive determination, to obscure the region and output a corresponding obscured-region digital image.

Core Innovation

The invention discloses systems and methods for privacy-aware image capture that include a digital image receiver configured to receive a digital image and an automatic obscuration processor coupled to the image receiver. The processor is configured to determine whether the digital image includes a region classified as an image of a category of identity-correlated object among multiple categories. Upon positive determination, the processor obscures the region and outputs an obscured-region digital image.

The disclosed systems feature automatic detection of identity-correlated objects in a captured digital image and output a privacy-protected image that obscures regions detected as containing such objects. The obscuring can be reversible or irreversible and can be category-specific. Categories can include personal identifiable information such as persons' faces, tattoos, name tags, and license plate numbers. The system can also detect particular patterns or arrangements of objects, obscuring combinations that constitute personal identification information.

The problem addressed by the invention arises from concerns about privacy when image capture devices capture personal identifiable information (PII) for purposes such as public safety and security. These concerns relate to the risk or perceived risk of unauthorized access to or distribution of image feeds. Examples of PII include features of persons' faces, automobile license plates, and name tags. The invention aims to provide privacy protection by automatically obscuring detected identity-correlated regions in images while maintaining the usefulness of image capture for security purposes.

Claims Coverage

The patent includes inventive features disclosed in two independent system claims and two independent method claims. These features focus on automatic detection and obscuration of identity-correlated regions in digital images and compressed moving picture digital images.

Automatic obscuring of identity-correlated regions and particular object patterns in digital images

A digital image receiver receives a digital image and an automatic obscuring processor determines whether the image includes identity-correlated regions belonging to multiple categories, particular patterns of objects including multiple identity-correlated objects, and combinations of logos or insignias on different apparel. Upon detection, the processor obscures these regions or patterns and outputs a privacy-protected digital image.

Erasure of original identity-correlated region data after obscuring

The automatic obscuration processor is further configured to erase all instances of the identity-correlated region in the system after outputting the privacy-protected digital image, ensuring no storage of original sensitive data.

Compressed format detection and obscuring in moving picture digital images

A digital image receiver receives compressed moving picture digital images with full frames spaced apart by image change frames. An automatic obscuring processor detects identity-correlated regions in full frames, generates new data for obscuring these regions, generates change frame versions of the new data, and outputs a privacy-protected compressed moving picture digital image based on the modified frames.

Dual mode operation for detection and obscuring in compressed and uncompressed moving images

The automatic obscuring processor can switch between a first mode that operates on compressed format images performing detection and obscuring on spaced frames, and a second mode that converts compressed moving pictures to uncompressed frames. In the second mode, detection and obscuring are applied to every rth frame; movement data is generated to locate corresponding regions in other frames, and obscuring is applied accordingly.

Method for automatic obscuring of identity-correlated regions, patterns, and apparel logo combinations in digital images

The method includes receiving a digital image, detecting identity-correlated regions of various categories, particular patterns based on combinations and arrangements of such objects, and combinations of logos or insignias on different types of apparel. Upon detection, the relevant regions or patterns are obscured, and a privacy-protected digital image is output.

Method for detection and obscuring in compressed moving picture digital images

The method includes receiving compressed moving picture images with spaced full frames, detecting identity-correlated regions in the full frames, generating new data for obscuring, generating change frame versions, obscuring the identity-correlated regions based on the new data, and outputting the privacy-protected compressed moving picture image with modified frames.

The independent claims disclose systems and methods involving automatic detection of identity-correlated regions, particular object patterns, and apparel logo combinations in digital and compressed moving images, applying reversible or irreversible obscuring, managing data erasure, and supporting dual modes of operation for real-time privacy protection across various image formats and categories.

Stated Advantages

Automatic detection and obscuring of identity-correlated regions enhances privacy protection in images containing personal identifiable information.

Category-specific obscuring allows tailored privacy measures depending on the type of identity-correlated object.

Capability to obscure particular patterns or combinations of objects that together constitute personal identification information provides robust privacy safeguards.

Support for reversible and irreversible obscuring methods enables flexible privacy control, including key-access reversible encryption.

Integrated processing supports real-time privacy protection in moving pictures with reduced computational burden through selective frame processing.

Management of privacy by erasing original identity-correlated data ensures no retention of sensitive information.

Documented Applications

Image capture devices for public safety and security applications where personal identifiable information is captured and privacy concerns arise.

Video surveillance systems capturing faces, license plates, name tags, tattoos, and other identity-correlated objects requiring privacy preservation.

Moving picture image capture and processing, including compressed video formats (e.g., H.264, H.265) with automatic privacy protection applied to full frames and propagated to change frames.

Privacy-aware image capture hardware integrated in security housings or motor-driven mounts for controlled field of view and secure image transmission.

Systems requiring selective access to privacy-protected images via key-based reversible obscuring and encryption key management for authorized entities.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.