Face Tracking Overview

Face Tracking lets you accurately detect and track human faces. Simple mask tracking lets you quickly apply effects only to a face, such as selective color correction or blurring a person’s face, and more.

However, with Face Tracking, you can track specific parts of the face such as pupils, mouth, and nose, allowing you to isolate and work on these facial features with greater detail. For example, change colors of the eyes or exaggerate mouth movements without frame-by-frame adjustments.

After Effects also lets you measure facial features. Tracking of facial measurements tells you details such as how open the mouth or an eye is. With each data point isolated, you could greatly refine content. Furthermore, you can also export detailed tracking data to Adobe Character Animator for performance-based character animation.

The face tracker works largely automatically, but you can obtain better results by starting the analysis on a frame showing a front, upright view of the face. Adequate lighting on the face can improve the accuracy of face detection.

In the Tracker panel, there are two face-tracking options:

  • Face Tracking (Outline Only): Use this option if all you want to track is the outline of the face.
  • Face Tracking (Detailed Features): Use this option if you want to detect eye (including eyebrow and pupil), nose, and mouth locations, and optionally, extract measurements of various features. This option is required if you want to use the tracking data in Character Animator.

    If you are using the Detailed Features option, a Face Track Points effect is applied to the layer. The effect contains several 2D effect control points with keyframes, each of which is attached to detected facial features (for example, the corners of the eyes and mouth, locations of pupils, the tip of the nose).

Tracking outline of a face

  1. In After Effects, select File > Import > File. Browse to the location of the footage, and add it to the Project.

    Project panel
  2. Drag the footage from the Project panel into a Composition to add a layer.

    Add a layer to your comp
  3. Position the current time indicator (CTI) to a frame showing a front, upright view of the face you want to track.

    Note:

    Face detection is improved if the initial frame to track has a face looking forward and is oriented upright.

    Face detection
  4. Draw a closed mask loosely around the face, enclosing the eyes and mouth. The mask defines the search region to locate facial features. If multiple masks are selected, the topmost mask is used.

    Draw a mask
  5. With the Mask selected, select Window > Tracker to open the Tracker panel. Set the tracking Method to Face Tracking (Outline Only).

    Choose a Tracking Method
  6. In the Tracker panel, track forward or backward one frame at a time to ensure that tracking is functioning correctly, and then, click the button to begin analyzing all frames.

  7. Once the analysis is complete, face tracking data is made available within the composition.

    Face tracking data in the comp

Tracking detailed features and extracting facial measurements

  1. In After Effects, select File > Import > File. Browse to the location of the footage, and add it to the Project.

  2. Drag the footage from the Project panel into a Composition to add a layer.

  3. Position the Current Time Indicator to a frame showing a front, upright view of the face you want to track.

    Note:

    Face detection is improved if the initial frame to track has a face looking forward and is oriented upright.

  4. Draw a closed mask loosely around the face, enclosing the eyes and mouth. The mask defines the search region to locate facial features. If multiple masks are selected, the topmost mask is used.

  5. With the Mask selected, select Window > Tracker to open the Tracker panel. Set the tracking Method to Face Tracking (Detailed Features).

  6. In the Tracker panel, track forward or backward one frame at a time to ensure that tracking is functioning correctly, and then, click the button to begin analyzing all frames.

  7. After the analysis is complete, the tracking data is made available within a new Effect called Face Track Points. You can choose to access face tracking data within the composition or the Effects (Window > Effect Controls) panel.

    Face Track Points Effect Controls
  8. Move the current-time indicator to a frame showing a neutral expression on the face (the rest pose). Face measurements on other frames are relative to the rest pose frame. In the Tracker panel, click Set Rest Pose.

  9. In the Tracker Panel, click Extract & Copy Face Measurements. A Face Measurements effect is added to the layer, and keyframes are created based on calculations made from the Face Track Points keyframe data. The Face Measurements keyframe data is copied to the system clipboard for use in Character Animator.

    Note:

    The keyframes for Face Measurements are generated based on the Face Track Points keyframe data, relative to the Rest Pose (refer to Step 8).

    Face Measurements Effect Controls

Face tracking data reference

Face Track Points

The Face Tracker effect creates effect control points for several facial features, which you can view in the Timeline panel.

Face Measurements

If you have used the Detailed Features option, you can extract even more information in the form of parametric measurements of facial features, known as Face Measurements. All measurements shown for the face you tracked are relative to the Rest Pose frame.

Face Offset

Indicates the position of the face, offsetting to 0% at Rest Pose frame. The following data points are made available indicating offset values on x, y, and z axes:

  • Offset X
  • Offset Y
  • Offset Z

Face Orientation

Indicates three-dimensional orientations of the face. Orientation is measured using the following data points, indicative of x, y, and z axes:

  • Orientation X
  • Orientation Y
  • Orientation Z

Left Eye

Indicates various points of measurement for the left eye, and includes the following data points:

  • Left Eyebrow Distance
  • Left Eyelid Openness
  • Left Eye Gaze X
  • Left Eye Gaze Y

Right Eye

Indicates various points of measurement for the right eye, and includes the following data points:

  • Right Eyebrow Distance
  • Right Eyelid Openness
  • Right Eye Gaze X
  • Right Eye Gaze Y

Mouth

Indicates various points of measurement for the mouth, and includes the following data points:

  • Mouth Offset X
  • Mouth Offset Y
  • Mouth Scale Width
  • Mouth Scale Height

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License  Twitter™ and Facebook posts are not covered under the terms of Creative Commons.

Legal Notices   |   Online Privacy Policy