System and method for a multi-primary wide gamut color system
Inventors
Bogdanowicz, Mitchell J. • Carbonara, Corey P. • Korpi, Michael F. • DeFilippis, James M. • Mandle, Gary B.
Assignees
Publication Number
US-11532261-B1
Publication Date
2022-12-20
Expiration Date
2039-10-21
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
The present invention includes systems and methods for a multi-primary color system for display. A multi-primary color system increases the number of primary colors available in a color system and color system equipment. Increasing the number of primary colors reduces metameric errors from viewer to viewer. One embodiment of the multi-primary color system includes Red, Green, Blue, Cyan, Yellow, and Magenta primaries. The systems of the present invention maintain compatibility with existing color systems and equipment and provide systems for backwards compatibility with older color systems.
Core Innovation
The invention introduces a system and method for a multi-primary color system for display, particularly targeting applications in virtual reality, augmented reality, and mixed reality environments. The core innovation lies in increasing the number of primary colors beyond the standard red, green, and blue (RGB) set, enabling configurations such as RGBCMY (red, green, blue, cyan, magenta, and yellow). The system utilizes a proprietary encoding method based on the CIE Yxy color space, in which image data is represented using a luminance (Y) channel and two independent colorimetric coordinates (x and y).
The background identifies shortcomings in current color systems, including increased metameric errors and limited color gamut due to the use of only three primaries (RGB) and restrictions in how image data is encoded and transported. Prior art attempted to increase color gamut or include additional primaries, but failed to provide a workflow and infrastructure supporting multi-primary color information transport outside the display or acquisition device itself, as well as maintaining backwards compatibility with legacy systems.
This invention addresses these problems by providing a complete system with an image data converter capable of encoding, processing, and decoding multi-primary color signals in the CIE Yxy color space, with explicit channel separation for luminance and chromaticity. The system is designed to convert image data for direct use in multi-primary displays and headsets, supporting both full and subsampled data, managing transport, and enabling compatibility with existing as well as advanced display technologies. Backwards compatibility and flexible interfacing are provided through compatible digital interfaces and look-up tables within the converter for seamless adaptation and gamut mapping.
Claims Coverage
There are three independent claims, each with unique inventive features covering system and method aspects for a multi-primary color display system centered on Yxy color space processing.
System utilizing CIE Yxy encoding and decoding for a multi-primary color display in a headset
The invention provides a system comprising: - A set of image data including primary color signals represented in the International Commission on Illumination (CIE) Yxy color space, where the values include luminance (Y) and two colorimetric coordinates (x and y), with x and y independent of Y. - An image data converter featuring a digital interface capable of encoding and decoding Yxy color space data. - A headset designed for virtual, augmented, or mixed reality environments, in communication with the image data converter. The system specifically transports processed Yxy data as three distinct channels (Y, x, y), with the converter operable to prepare the image data for display on the headset.
System extending headset communication to remote AR/VR devices and applications
This inventive feature expands the above system by: - Including at least one remote device (such as a mobile phone, tablet, gaming system, computer, or another AR/VR headset) with an augmented reality or virtual reality (AR/VR) application. - Enabling the headset to communicate both with the image data converter and with the remote device. - Ensuring the encode and decode process includes transportation of three-channel Yxy data (Y, x, y), and that the image data converter can convert image data for headset display. This claim emphasizes system interoperability across AR/VR devices and applications through Yxy-based processing.
Method for displaying multi-primary color data via Yxy encoding and headset transport
The inventive method comprises: 1. Providing image data in the form of primary color signals mapped to CIE Yxy color space (Y, x, y). 2. Encoding this data using a digital interface of an image data converter in communication with a suitable headset. 3. Processing and decoding the image data in CIE Yxy space using the same interface. 4. Converting the decoded data for display on the headset, with the processed data being transported as separate Y, x, and y channels. The method further allows for integration with remote devices and application of at least one non-linear function for image data processing in the Yxy space.
The inventive features collectively define a system and method for encoding, transporting, and displaying multi-primary color information using CIE Yxy color coordinates, supporting advanced display devices, headset integration, and interoperability with AR/VR applications and remote devices.
Stated Advantages
Increasing the number of primary colors reduces metameric errors from viewer to viewer.
The systems maintain compatibility with existing color systems and equipment, allowing for backwards compatibility with older color systems.
The Yxy or Yu′v′ encoding allows for transport of more than three primaries without increasing data payloads and can be substituted into any RGB file or transport system.
Chromaticity coordinates (x, y) are independent from luminance (Y), simplifying conversions between standard dynamic range (SDR) and high dynamic range (HDR) content.
The system enables flexible sampling options (full sampling or subsampling), supporting reduced bandwidth while preserving image quality.
The system provides a generic, device-agnostic signal format, enabling easy adaptation to displays with any number of color primaries and various white points.
Conversion from wide gamut cameras to multi-primary displays can be performed using a multiple triad conversion method, simplifying data transmission and display adaptation.
Out-of-gamut management is handled by the display rather than media definitions, maximizing display performance and preserving creative intent.
The encoder and decoder modules support multi-output formats and low-latency processing, with integrated support for both legacy and multi-primary formats.
Documented Applications
Use in headsets configured for virtual reality, augmented reality, and mixed reality environments to enable multi-primary color display.
Application in AR/VR systems with remote devices such as mobile phones, tablets, gaming systems, computers, and other AR/VR headsets for synchronized color data transmission and display.
Implementation in display and projection technologies including dual stack LCD projection systems, single projector solutions, DMD projectors, OLED and LCD monitors, and quantum dot displays to realize multi-primary color reproduction.
Use within single-device systems capable of image capture, processing, and multi-primary color display, including cameras, smartphones, wearable devices, and tablets.
Enabling display engines and graphics processing units (GPU) in computers, video cards, and mobile devices to process and output multi-primary color data using the Yxy color space.
Interested in licensing this patent?