Tracking 3D camera movement

  1. After Effects User Guide
  2. Beta releases
    1. Beta Program Overview
    2. After Effects Beta Home
  3. Getting started
    1. Get started with After Effects
    2. What's new in After Effects 
    3. Release Notes | After Effects
    4. After Effects system requirements
    5. Keyboard shortcuts in After Effects
    6. Supported File formats | After Effects
    7. Hardware recommendations
    8. Planning and setup
    9. Setup and installation
  4. Workspaces
    1. General user interface items
    2. Get to know After Effects interface
    3. Workflows
    4. Workspaces, panels, and viewers
  5. Projects and compositions
    1. Projects
    2. Composition basics
    3. Precomposing, nesting, and pre-rendering
    4. View detailed performance information with the Composition Profiler
    5. CINEMA 4D Composition Renderer
  6. Importing footage
    1. Preparing and importing still images
    2. Importing from After Effects and Adobe Premiere Pro
    3. Importing and interpreting video and audio
    4. Preparing and importing 3D image files
    5. Importing and interpreting footage items
    6. Working with footage items
    7. XMP metadata
  7. Working with text and graphics
    1. Text
      1. Formatting characters and the Character panel
      2. Text effects
      3. Creating and editing text layers
      4. Formatting paragraphs and the Paragraph panel
      5. Extruding text and shape layers
      6. Animating text
      7. Examples and resources for text animation
      8. Live Text Templates
    2. Motion Graphics
      1. Work with Motion Graphics templates in After Effects
      2. Use expressions to create drop-down lists in Motion Graphics templates
      3. Work with Essential Properties to create Motion Graphics templates
      4. Replace images and videos in Motion Graphics templates and Essential Properties
  8. Drawing, painting, and paths
    1. Overview of shape layers, paths, and vector graphics
    2. Paint tools: Brush, Clone Stamp, and Eraser
    3. How to taper shape strokes
    4. Shape attributes, paint operations, and path operations for shape layers
    5. Use Offset Paths shape effect to alter shapes
    6. Creating shapes
    7. Create masks
    8. Remove objects from your videos with the Content-Aware Fill panel
    9. Roto Brush and Refine Matte
  9. Working with layers
    1. Selecting and arranging layers
    2. Blending modes and layer styles
    3. 3D layers
    4. Layer properties
    5. Creating layers
    6. Managing layers
    7. Layer markers and composition markers
    8. Cameras, lights, and points of interest
  10. Animation, keyframing, motion tracking, and keying
    1. Animation
      1. Animation basics
      2. Animating with Puppet tools
      3. Managing and animating shape paths and masks
      4. Animating Sketch and Capture shapes using After Effects
      5. Assorted animation tools
      6. Work with Data-driven animation
    2. Keyframe
      1. Keyframe interpolation
      2. Setting, selecting, and deleting keyframes
      3. Editing, moving, and copying keyframes
    3. Motion tracking
      1. Tracking and stabilizing motion
      2. Face Tracking
      3. Mask Tracking
      4. Mask Reference
      5. Speed
      6. Time-stretching and time-remapping
      7. Timecode and time display units
    4. Keying
      1. Keying
      2. Keying effects
  11. Transparency and compositing
    1. Compositing and transparency overview and resources
    2. Alpha channels, masks, and mattes
  12. Adjusting color
    1. Color basics
    2. Use the Adobe Color Themes extension
    3. Color management
    4. Color Correction effects
  13. Effects and animation presets
    1. Effects and animation presets overview
    2. Effect list
    3. Simulation effects
    4. Stylize effects
    5. Audio effects
    6. Distort effects
    7. Perspective effects
    8. Channel effects
    9. Generate effects
    10. Transition effects
    11. The Rolling Shutter Repair effect
    12. Blur and Sharpen effects
    13. 3D Channel effects
    14. Utility effects
    15. Matte effects
    16. Noise and Grain effects
    17. Detail-preserving Upscale effect
    18. Obsolete effects
  14. Expressions and automation
    1. Expression
      1. Expression basics
      2. Understanding the expression language
      3. Using expression controls
      4. Syntax differences between the JavaScript and Legacy ExtendScript expression engines
      5. Editing expressions
      6. Expression errors
      7. Using the Expressions editor
      8. Use expressions to edit and access text properties
      9. Expression language reference
      10. Expression examples
    2. Automation
      1. Automation
      2. Scripts
  15. Immersive video, VR, and 3D
    1. Construct VR environments in After Effects
    2. Apply immersive video effects
    3. Compositing tools for VR/360 videos
    4. Tracking 3D camera movement
    5. Work in 3D Design Space
    6. Preview changes to 3D designs real time with the Real-Time Engine
    7. Add responsive design to your graphics 
  16. Views and previews
    1. Previewing
    2. Video preview with Mercury Transmit
    3. Modifying and using views
  17. Rendering and exporting
    1. Basics of rendering and exporting
    2. Export an After Effects project as an Adobe Premiere Pro project
    3. Converting movies
    4. Multi-frame rendering
    5. Automated rendering and network rendering
    6. Rendering and exporting still images and still-image sequences
    7. Using the GoPro CineForm codec in After Effects
  18. Working with other applications
    1. Dynamic Link and After Effects
    2. Working with After Effects and other applications
    3. Sync Settings in After Effects
    4. Collaborate with Team Projects
    5. Share and manage changes with Team Project collaborators
    6. Creative Cloud Libraries in After Effects
    7. Plug-ins
    8. CINEMA 4D and Cineware
  19. Memory, storage, performance
    1. Memory and storage
    2. Improve performance
    3. Preferences
    4. GPU and GPU driver requirements for After Effects

3D camera tracker effect

The 3D camera tracker effect analyzes video sequences to extract camera motion and 3D scene data. The 3D camera motion allows you to correctly composite 3D elements over your 2D footage.

Note:

Like the Warp Stabilizer, the 3D camera tracker effect performs analysis using a background process. Feel free to adjust settings or work on a different part of your project while analysis is taking place.

Analyzing footage and extracting camera motion

  1. With a footage layer selected, do one of the following:
    1. Choose Animation > Track Camera, or choose Track Camera from the layer context menu.
    2. Choose Effect > Perspective > 3D Camera Tracker.
    3. In the Tracker panel, click the Track Camera button.

      The 3D Camera Tracker effect is applied. The analysis and solving phases occur in the background, with status appearing as a banner on the footage and next to the Cancel button.

  2. Adjust the settings, as needed.

The 3D solved track points appears as small colored x's. You can use these track points to place content into the scene.

Note:

You can select more than one layer at a time for camera tracking using the 3D camera tracker effect.

Attaching content into a scene containing a solved camera

  1. With the effect selected, select the track point or multiple track points (defining a best-fit plane) to use as the attach point.
    1. Hover between three neighboring unselected track points that can define a plane, a semitransparent triangle appears between the points. A red target appears, showing the orientation of the plane in 3D space.
    2. Draw a marquee-selection box around multiple track points to select them.
  2. Right-click above the selection or target, and then choose the type of content to create. The following types can be created:
    • Text
    • Solid
    • Null layer for the center of the target
    • Text, solid, or null layer for each selected point
    • "Shadow catcher" layer (a solid that accepts shadows only) for the created content by using the Create Shadow Catcher command in the context menu.
Note:

A shadow catcher layer also creates a light if one does not exist.

Note:

If creating multiple layers, each one has a unique numbered name. If creating multiple text layers, In and Out points are trimmed to match the point durations.

Moving the target to attach content to different location

To move the target so that you can attach content to a different location, do the following:

  1. When above the center of the target, the "move" cursor appears for repositioning the target.
  2. Drag the center of the target to desired location.

Once at the intended location, you can attach content by using the commands in the context menu.

Note:

If the size of the targets is too small or too large to see, you can resize them to help visualize the planes. The target size also controls the default size of text and solid layers created using the context menu commands.

Resizing a target

To resize a target, do one of the following:

  • Adjust the Target Size property.
  • Press Alt-click (Windows) or Option-click (Mac OS) as you drag from the center of the target. When above the center of the target, a cursor with horizontal arrows allows you to resize the target.

Selecting and deselecting track points

To select track points, do one of the following:

  • Click a track point.
  • Click between three adjacent track points.
  • Draw a marquee-selection box around multiple points.
  • Shift-click or draw a Shift-marquee selection box around the track points to add multiple track points to the current selection.

To deselect track points, do one of the following:

  • Alt-click (Windows) or Option-click (Mac OS) selected track points.
  • Click away from a track point.
Note:

Moving objects can confuse the 3D camera tracker effect. It can interpret points for stationary objects close to the camera as moving due to parallax. To help solve the camera, delete bad or unwanted points.

Deleting unwanted track points

To delete unwanted track points, do the following:

  1. Select the track points.
  2. Press Delete or choose Delete Selected Points from the context menu.

After deleting unwanted track points, the camera is resolved. You can delete additional points while resolving takes place in the background. Deleting 3D points deletes the corresponding 2D points, as well.

Creating a "shadow catcher" layer

You can quickly create a "shadow catcher" layer, used to create realistic shadows for the effect. A shadow catcher layer is white solid the same size as the footage, but set to accept shadows only.

To create a shadow catcher layer, use the Create Shadow Catcher, Camera and Light commands in the context menu.

If necessary, adjust the position and scale of the shadow catcher layer so the cast shadow appears as desired. This command also creates a shadow-casting light (a light that is switched on, and casts shadows) if one does not exist in the composition.

Effect controls for the 3D camera tracker

The effect has the following controls and settings:

Analyze/Cancel

Starts or stops the background analysis of the footage. During analysis, status appears as a banner on the footage and next to the Cancel button.

Shot Type

Specifies whether the footage was captured with a fixed horizontal angle of view, variable zoom, or a specific horizontal angle of view. Changing this setting requires a resolve.

Horizontal Angle of View

Specifies the horizontal angle of view the solver uses. Enabled only when Shot Type is set to Specify Angle of View.

Show Track Points

Identifies detected features as 3D points with perspective hinting (3D Solved) or 2D points captured by the feature track (2D Source).

Render Track Points

Controls if the track points are rendered as part of the effect.

Note:

When the effect is selected, track points are always shown, even if Render Track Points is not selected. When enabled, the points are displayed into the image allowing them to be seen during preview.

Track Point Size

Changes the displayed size of the track points.

Create Camera

Creates the 3D camera. A camera is automatically added when you create a text, solid, or null layer from the context menu.

Advanced controls

Advanced controls for the 3D camera tracker effect:

  • Solve Method: Provides hints about the scene to help in solving the camera. Solve the camera by trying the following:
    • Auto Detect: Automatically detects the scene type.
    • Typical: Specifies the scene as that which are not purely rotational, or mostly flat.
    • Mostly Flat Scene: Specifies the scene as mostly flat, or planar.
    • Tripod Pan: Specifies the scene as purely rotational.
  • Method Used: When Solve Method is set to Auto Detect, this displays the actual solve method used.
  • Average Error: Displays the average distance (in pixels) between the original 2D source points and a reprojection of the 3D solved points onto the 2D plane of the source footage. If a track/solve was perfect, this error would be 0 and there would be no visible difference if you toggled between 2D Source and 3D Solved track points. You can use this value to tell if deleting points, changing the solve method, or making other changes is lowering this value, and thus improving the track.
  • Detailed Analysis: When checked, makes the next analysis phase do extra work to find elements to track. The resulting data (stored in the project as part of the effect) is much larger and slower with this option enabled.
  • Auto-delete Points Across Time: With the new Auto-delete Track Points Across Time option, when you delete track points in the Composition panel, corresponding track points (i.e., track points on the same feature/object) are deleted at other times on the layer. You don’t need to delete the track points frame by frame to improve the quality of the track. For example, you can delete track points on a person running through the scene, whose motion should not be considered for the determination of how the camera was moving in the shot.
  • Hide Warning Banner: Use when you don't want to reanalyze footage even though there is a warning banner indicating that it be reanalyzed.

Ground plane and origin in 3D Camera Tracker effect

You can define a ground plane (reference plane) and origin, for example, the (0,0,0) point of the coordinate system within the 3D Camera Tracker effect.

  1. Analyze the scene using the 3D Camera Tracker effect
  2. Select a set of tracking points. This action causes the bullseye target to appear, showing the plane defined by the selected tracking points.
  3. Optionally drag the target by its center to reposition it along the plane, and place the center is where you want the origin to be.
  4. Right-click (Windows) or Control-click (Mac OS) the target and choose Set Ground Plane And Origin.

This action does not have any visible result, but the reference plane and origin of the coordinate system are saved for this scene. Any items that you create from within this instance of the 3D Camera Tracker effect are created using this plane and origin.

Note:

If you choose Set Ground Plane And Origin again, a warning tells you that objects already created using a different ground plane and origin are not to be updated using the new ground plane and origin.

Auto-delete Points Across Time

In the Advanced section of the effect properties, there is a new option: Auto-delete Points Across Time.

If this option is on, when you delete track points in the Composition panel, corresponding track points (for example, track points on the same feature or object) are deleted at other times on the layer, so it isn't necessary to delete the track points frame by frame to improve the quality of the track. For example, you can delete track points on a person running through the scene, whose motion should not be considered for the determination of how the camera was moving in the shot. This method works for both 2D Source and 3D Solved track points.

You can delete selected track points with the Delete key or by context-clicking and choosing Delete Selected Points.

Note:

Even with the new Auto-delete Points Across Time feature, you can instead or additionally define an alpha channel for the layer to prevent the 3D Camera Tracker effect from considering a specific part of the image for determining a camera.

Export 3D Camera Tracker data to 3D applications

You can export 3D Camera Tracker data to 3D applications like MAXON CINEMA 4D.

Do the following:

  1. Choose File > Export > MAXON Cinema 4D Exporter.

  2. In the Text Exporting dialog box that opens, choose the Extrude or Text option.

    Exporting to MAXON Cinema 4D Exporter
    Exporting to MAXON Cinema 4D Exporter

  3. Name the file and click Save.

  4. Open the file in the 3D application.

Adobe logo

Sign in to your account