Video application graphical effects

Inventors

Scapel, Nicolas V. • Manzari, Johnnie B. • Yerkes, Giancarlo

Assignees

Apple Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12737049-B2

Patent

Publication Date

2026-09-15

Expiration Date


Abstract

The present disclosure generally relates to methods and user interfaces for displaying graphical effects in a video application. In some embodiments, methods and user interfaces for displaying graphical effects during a real-time communication session are described. In some embodiments, methods and user interfaces for sharing content during a real-time communication session are described. In some embodiments, methods and user interfaces for displaying graphical effects in multiple video applications are described. In some embodiments, methods and user interfaces for framing a subject in a representation of the field of view of one or more camera sensors is described.

Core Innovation

The invention concerns concurrently displaying a representation of a field of view of a first camera sensor together with a first representation of a participant associated with a computer system and a second representation of a participant associated with an external computer system. The participant associated with the computer system is different from the participant associated with the external computer system, and the external computer system is different from the computer system. While both representations are concurrently displayed, a first gesture performed by a first portion of the participant associated with the computer system is detected within the field of view.

In response to detection of the first gesture, the invention determines whether the first gesture is maintained for more than a predetermined duration. If the first gesture is maintained for more than the predetermined duration and is detected at a first gesture location in the field of view, a first graphical effect is displayed at a first effect location in the representation of the field of view. If the first gesture is maintained for more than the predetermined duration and is at a second gesture location in the field of view that is different from the first gesture location, the first graphical effect is displayed at a second effect location that is different from the first effect location.

If the first gesture is maintained for less than the predetermined duration, the invention forgoes displaying the first graphical effect while the representation of the first portion of the participant performing the first gesture is displayed. The disclosed behavior therefore links graphical effects to gesture maintenance duration and gesture location within the field of view representation.

Claims Coverage

The provided independent claims are a computer system, a non-transitory computer-readable storage medium, and a method. Across these independent claims, the main inventive features involve concurrently displaying a camera field-of-view representation with multiple participant representations, detecting a gesture within the field of view, and conditionally displaying or forgoing a graphical effect at gesture-aligned effect locations based on predetermined duration and gesture location.

Concurrent field-of-view display with distinct participants

concurrently displaying, via the display generation component, a representation of a field of view of the first camera sensor, wherein the representation of the field of view of the first camera sensor includes a first representation of a participant associated with the computer system; and a second representation of a participant associated with an external computer system, wherein the participant associated with the computer system is different from the participant associated with the external computer system; and the external computer system is different from the computer system

Gesture detection within participant field of view

while the representation of the field of view of the first camera sensor including the first representation is concurrently displayed with the second representation, a first gesture performed by a first portion of the participant associated with the computer system is detected within the field of view of the first camera sensor, wherein a representation of the first portion of the participant is included in the first representation

Maintained-gesture conditional graphical effect at gesture-aligned effect locations

in response to detection of the first gesture performed by the first portion of the participant associated with the computer system: in accordance with a determination that the first gesture is maintained for more than a predetermined duration and that the first gesture is detected at a first gesture location in the field of view of the first camera sensor, displaying, via the display generation component, a first graphical effect at a first effect location in the representation of the field of view of the first camera sensor; in accordance with a determination that the first gesture is maintained for more than the predetermined duration and that the first gesture is at a second gesture location in the field of view of the first camera sensor that is different from the first gesture location, displaying, via the display generation component, the first graphical effect at a second effect location in the representation of the field of view of the first camera sensor that is different from the first effect location; and in accordance with a determination that the first gesture is maintained for less than the predetermined duration, forgoing displaying the first graphical effect while the representation of the first portion of the participant performing the first gesture is displayed

The independent claims consistently define an interactive graphical effects framework: concurrently display a camera field-of-view representation with distinct participant representations, detect a gesture within that field of view, and conditionally display or forgo a graphical effect at effect locations aligned to the gesture location depending on whether the gesture is maintained longer than a predetermined duration.

Stated Advantages

Not explicitly described in patent.

Documented Applications

Not explicitly described in patent.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.