Devices, methods, and graphical user interfaces for real-time communication

Inventors

Chiu, Shih-Sang • Ngo, Long H. • Holder, Wesley M. • Lemay, Stephen O. • Sorrentino, III, William A. • Bhardwaj, Rajat • Yerkes, Giancarlo • Rickwald, Jason D. • BURTON, Rupert

Assignees

Apple Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12762813-B2

Patent

Publication Date

2026-10-13

Expiration Date


Abstract

The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for real-time communications.

Core Innovation

The described invention provides a real-time communication user interface displayed within a three-dimensional environment. A participant appears as a three-dimensional representation within a spatially constrained portal, and detected participant movement is displayed as movement of the representation within the portal. When a portion of the representation approaches a portal boundary, its visual appearance changes through distortion, fading, cropping, blurring, or movement limits.

The computer system enables transitions between spatially constrained and spatially flexible representation modes, gaze- and hand-tracking interactions, and viewpoint sharing with session participants. Portal background content is incorporated using imagery from outward-facing cameras, reconstructing unseen environmental regions while suppressing faces or bright light sources. This presentation conveys participant context while preserving privacy and avoiding rear-facing cameras.

Claims Coverage

The patent includes three independent claims (claim 1 for a computer system, claim 26 for a non-transitory computer-readable storage medium, and claim 51 for a method) that share three inventive features.

Portal-based participant representation in a real-time communication interface

Each independent claim recites displaying, within a three-dimensional environment, a real-time communication user interface that includes a first spatially-constrained representation of a participant comprising a first portal and a first three-dimensional representation displayed within the portal.

Movement-responsive representation within the portal

Each independent claim recites receiving an indication of detected movement by the participant and displaying movement of the three-dimensional representation within the portal in response.

Boundary-triggered visual appearance change

Each independent claim recites changing the visual appearance of the three-dimensional representation based on a determination that a portion of the representation is approaching a boundary of the portal, with effects including visual distortion, fading, cropping, or blurring.

The three independent claims cover the same core functionality across system, storage-medium, and method claim forms: displaying a participant representation within a portal, moving the representation in response to detected participant movement, and altering its visual appearance as a portion approaches the portal boundary.

Stated Advantages

The portal background conveys participant context while preserving privacy and avoiding rear-facing cameras.

Documented Applications

A real-time communication session between a user and one or more participants, presented through a real-time communication user interface in a three-dimensional environment.

Sharing a user's three-dimensional-environment viewpoint with another participant.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.