Devices and methods for motion planning of computer characters

Inventors

Kurz, Daniel • Masood, Novaira • Nguyen, Shem • Bernstein, Jeremy R.

Assignees

Apple Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12737992-B2

Patent

Publication Date

2026-09-15

Expiration Date


Abstract

A computer-generated environment may include computer characters. Characteristics of the real-world environment are estimated and the interactions between computer characters and the real-world environment can be based on the estimated characteristics.

Core Innovation

An electronic device presents, using the display, a computer-generated environment including a real-world environment and a virtual agent with an affinity for one or more characteristics of the real-world environment. The one or more characteristics include at least one of lighting, materials, temperature, or geographic properties. While the computer-generated environment is presented, the electronic device detects, using one or more input devices, a first characteristic of the one or more characteristics.

In accordance with the detected first characteristic and in accordance with the affinity for the one or more characteristics including a first affinity for the first characteristic, the electronic device causes the virtual agent to perform a first action. The first action includes one of performing an activity, orienting the virtual agent or a virtual object in the computer-generated environment, placing the virtual object in the computer-generated environment, movement of the virtual agent or modifying the movement of the virtual agent, or dwelling in the computer-generated environment.

The movement of the virtual agent in accordance with the first characteristic and in accordance with the affinity includes moving toward or in one or more first regions of the computer-generated environment that the virtual agent favors and moving from or avoiding one or more second regions of the computer-generated environment that the virtual agent disfavors. In certain implementations, movement includes creating or modifying a navigation plan, where the navigation plan increases time or distance within favored regions and decreases time or distance within disfavored regions.

Claims Coverage

The provided partial content includes four independent method claims. Across the independent claims, the inventive features are directed to presenting a computer-generated environment with a virtual agent having affinities for detected real-world characteristics, and causing agent actions and movement behavior that favor first regions and avoid second regions, including generating or modifying a navigation plan to allocate time or distance accordingly.

Presenting a virtual agent with affinity to real-world characteristics

Presenting, using the display, a computer-generated environment including a real-world environment and a virtual agent with an affinity for one or more characteristics of the real-world environment, wherein the one or more characteristics include at least one of lighting, materials, temperature, or geographic properties.

Detecting a characteristic of the real-world environment using input devices

While presenting the computer-generated environment, detecting, using the one or more input devices, a first characteristic of the one or more characteristics of the real-world environment.

Causing an action based on the detected characteristic and affinity

Causing the virtual agent to perform a first action in accordance with the first characteristic of the real-world environment and in accordance with the affinity for the one or more characteristics including a first affinity for the first characteristic, wherein the first action includes one of performing an activity, orienting the virtual agent or a virtual object in the computer-generated environment, placing the virtual object in the computer-generated environment, movement of the virtual agent or modifying the movement of the virtual agent, or dwelling in the computer-generated environment.

Favoring regions and avoiding disfavored regions through movement

The movement of the virtual agent in accordance with the first characteristic of the real-world environment and in accordance with the affinity for the one or more characteristics including the first affinity for the first characteristic comprises moving toward or in one or more first regions of the computer-generated environment that the virtual agent favors and moving from or avoiding one or more second regions of the computer-generated environment that the virtual agent disfavors.

Creating a navigation plan to increase time or distance in favored regions

The movement of the virtual agent in accordance with the first characteristic of the real-world environment and in accordance with the affinity for the one or more characteristics including the first affinity for the first characteristic comprises creating a navigation plan for the virtual agent to increase time or distance of the navigation plan within one or more first regions of the computer-generated environment that the virtual agent favors and to decrease time or distance of the navigation plan within one or more second regions of the computer-generated environment that the virtual agent disfavors.

Modifying a navigation plan to increase time or distance in favored regions

Modifying the movement of the virtual agent in accordance with the first characteristic of the real-world environment and in accordance with the affinity for the one or more characteristics including the first affinity for the first characteristic comprises modifying a navigation plan for the virtual agent to increase time or distance of the navigation plan within one or more first regions of the computer-generated environment that the virtual agent favors and to decrease time or distance of the navigation plan within one or more second regions of the computer-generated environment that the virtual agent disfavors.

Across the independent claims, the virtual agent’s affinities for lighting, materials, temperature, or geographic properties are used with detected real-world characteristics to select an action and to control movement. The movement favors first regions and avoids second regions, and in additional implementations the movement includes creating or modifying a navigation plan that increases time or distance in favored regions and decreases time or distance in disfavored regions.

Stated Advantages

Documented Applications

No documented applications found

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.