Learn more about Premiere Pro support for VR workflows.

Premiere Pro offers support for viewing VR video in the Monitor panels. It also detects if the clip or sequence has VR properties and automatically configures the VR viewer accordingly. You can publish VR video directly to the web from Premiere Pro to sites such as YouTube or Facebook. 

Using Premiere Pro to edit VR videos

VR Video Monitor Panel
VR Video Monitor Panel

VR Auto-detection

To determine if a clip has VR properties assigned to it:

  1. Select Project Panel > Properties.

  2. The VR Projection option in the Properties panel indicates whether the clip has VR properties assigned to it.

VR properties

The Source Monitor Settings options for VR video remain disabled when a clip that does not have VR properties is viewed. If the clip has VR properties assigned, it indicates the presence of three VR properties:

  • VR Projection
  • VR Layout
  • VR Captured View

Interpreting VR footage

You would want to interpret the VR footage when:

  • A VR clip has been imported but the Properties screen shows VR Projection: None.
  • The VR Projection, VR Layout, and VR Captured View properties are present but have incorrect values assigned.

This information is stored with the Premiere Pro project file. When video clips have VR properties associated with them, the Source Monitor Settings menu displays the option for VR Video. Otherwise, this option is dimmed out.

To interpret VR footage, follow these steps:

  1. Select the clip in the Project Panel and then select Modify > Interpret Footage.

    Interpreting VR footage
    Interpreting VR footage

  2. Specify the appropriate settings in VR Properties.

VR assignments

VR properties are assigned to clips when VR properties get written into the clip's metadata when it was created. There are no VR properties in the metadata associated with the clips but the importer detects, based on frame dimensions, that it's a VR clip.

  • If the frame size dimensions are 1:1, the clip is interpreted to be Stereoscopic over/under VR
  • If the dimensions are 2:1, the clip is interpreted as Monoscopic VR.
  • If the dimensions are 4:1, the clip is interpreted as Stereoscopic side-by-side VR.

Note:

The auto detection is limited to specific frame heights of 960, 1920, 2048, 2880, 4096, 5760, 6000, and 8192.

Assigning VR properties to sequences

To determine if a sequence has VR properties assigned to it, select the Sequence Settings screen from the Sequence menu when it is open in the Timeline panel. The Source and Program Monitor Settings options for VR Video remain disabled when a sequence that does not have VR properties is viewed.

To assign VR properties to a VR sequence, select Sequence Settings > VR Properties, and then do one of the following:

Create a sequence from a clip that already has VR properties

  1. In the Project panel, right-click the clip that has VR properties.

  2. From the pop-up menu, select New Sequence From Clip.

Create a sequence that includes VR properties

To create a sequence that includes the VR properties, select New Sequence Settings > VR Properties, and then specify the VR settings.

Add VR properties to an existing sequence

  1. In the Project panel, right-click the sequence.

  2. From the pop-up menu, select Sequence Settings.

  3. In the VR Properties section, specify the VR settings. 

When sequences have VR properties associated with them, they are viewed in either the Source Monitor or the Program Monitor. The Monitor Settings menu shows the available options for VR Video available (not dimmed out).

VR properties for sequences
VR properties for sequences

Hiding VR video view controls

The VR view available in the Source and Program Monitors displays scroll bars and hot-text controls for changing pan and tilt, along with a dial that supports continual pan of the VR view. You can also turn off the display of these controls if you want to maximize the video display area in Source and Program monitors.

  1. To turn off the controls, select VR Video > Hide Controls from the Source or Program Monitors Settings menu. 

  2. You could also map this option to a keyboard shortcut. The state of control is available for each monitor and they are saved with the project.

Hiding VR video view controls
Hiding VR video view controls

Track Head-Mounted Display

Select Track Head-Mounted Display to link the VR view in the monitor to the view that is seen in a head-mounted VR display. This option gets highlighted when you install a VR headset along with supporting third-party plug-ins such as Mettle for Premiere Pro. Otherwise this option is disabled. 

Settings

The VR properties on clips and sequences are automatically configured in Export Settings when the export Format is set to H264, HEVC, or QuickTime. You can view these Export Settings in the bottom of the Video options in the VR Video section. You can also change the settings here.

360-degree panning

Use the dial at the bottom for 360-degree continuous panning, which indicates the direction of view. 

Using the dial for 360-degree continuous panning
Using the dial for 360-degree continuous panning

To center the view, double click within the video frame. Use either of these methods to change the view interactively during playback and while the video is paused. To return to the normal monitor display, open the Monitor Settings menu and deselect the Enable option for VR Video. 

To toggle between enabling and disabling your VR Video display use the button which can be docked with the monitor’s playback buttons. To open the button editor, click the up arrow available the lower right corner of the monitor. Drag the Toggle VR Video Display button out of the editor and move it into the monitor panel to the desired location. This button helps toggle between the normal monitor display and VR Video display.

Publishing your VR Video

To publish your VR Video on websites such as YouTube and Facebook:

  1. Select Export Settings >Video Settings tab. 

  2. Encode the video using H.264, HEVC, or QuickTime formats.

  3. Scroll down to check that the Video is VR check box and choose the layout which matches your media from the pop-up menu. Based on the metadata that gets added to the encoded video, Premiere Pro recognizes the video as VR Video content for publishers to play back correctly.

  4. Use the Stretch to Fill Scaling setting under Export Settings to get the best results for VR video exports. 

  5. Select Export Settings > Publish dialog to upload this video directly to websites such as YouTube or Facebook.

Note:

There could be a delay after the uploading gets completed before the video is playable in VR mode.

Video: VR Video Workflow

Learn how to work with VR media directly, including stereo media, so you can edit sequences, apply special effects and output 360-degree projects tagged properly for media players.

(Watch, 5 min)

Three-axis video rotation

You can also mix and match different resolutions and stereoscopic/monoscopic layouts in the same sequence. When you mix various equirectangular VR clips into a sequence, some match the resolution and match the stereoscopic layout while some do not. Use the VR Projection effect and choose the appropriate layout and video to properly fill the frame. In addition, you may need to correct the zero angle because of improper camera placement or subject matter focus. You can correct this by choosing to rotate the video using pan, roll, and tilt controls.

You can also play this rotation back in real time, when doing this ensure that GPU acceleration is turned on. 

Using three-axis video rotation
Using three-axis video rotation

  1. If you want to clip to be scaled to fill the frame regardless of aspect ratio or frame size, select VR Projection > Stretch To Fill frame

  2. To define the stereoscopic/monoscopic layout of your clip that matches the VR Properties on your Master Clip, select VR Projection > Input Layout.

  3. To define the desired output stereoscopic/monoscopic layout which usually matches the VR Properties on your Sequence Output Layout, select VR Projection > Output Layout

  4. To view the left to right orientation of the sphere, select VR Projection > Pan.

  5. To view the bottom to top orientation of the sphere, select VR Projection > Tilt.

  6. To view the counter-clockwise to clockwise orientation of the sphere, select VR Projection > Roll.

Effect Controls
Effect Controls

Assembling Ambisonics Audio

Used by enthusiasts, Ambisonics is a full-sphere surround sound technique that allows users to cover sound sources above and below the listener in addition to the horizontal plane. Unlike other multichannel surround formats, its transmission channels do not carry speaker signals. Instead, they contain a speaker-independent representation of a sound field called B-format, which is then decoded to the listener's speaker setup. This extra step allows the producer to think in terms of source directions rather than loudspeaker positions, and offers the listener a considerable degree of flexibility as to the layout and number of speakers used for playback.

You can assemble Ambisonics audio along with 360 video to create an immersive experience. To check for proper alignment, you would need to monitor the Ambisonics audio as you change its orientation. The audio media could be contained in separate audio files, often in uncompressed WAV using PCM encoding, but they could also be contained in MP4 using AAC encoding. 

Considerations when using Ambisonics Audio

  • When you are importing multichannel mono media, import it as adaptive track audio.
  • VR sequence presets are available under either the Audio Track Mixer or in the Audio Effects folder located under the Audio Effects panel.
  • When you are exporting media, select Export Settings > H.264 > VR Ambisonics (choose any setting under Ambisonics as required) 

Monitoring Ambisonics audio

You can use Premiere Pro to import Ambisonics media and accurately monitor it spatially using a pair of headphones. 

  1. Select File>New Sequence>Sequence Presets>VR.

  2. Choose VR>Monoscopic 29.97 > 2048x2048 - Ambisonics or VR>Stereoscopic 29.97> 2048x2048. 

  3. Create a sequence containing multi-channel Ambisonics audio. 

  4. Apply Binauralizer - Ambisonics effect on the Master track under Audio Track Mixer.

    Applying the Binauralizer-Ambisonics effect
    Applying the Binauralizer-Ambisonics effect

    • Use Pan for left to right orientation.
    • Use Tilt for bottom to top orientation.
    • Use Roll for counter-clockwise to clockwise rotation.

    All three controls have a range of -180 to +180 degrees.

  5. To monitor in a different direction, click the knob control of the effect and change the left-to-right Pan.

  6. Click the control enumeration menu at the bottom of the effect. Click to change Tilt to listen upward or downward, or use Roll to rotate your head clockwise or counter-clockwise.

  7. After you apply the effect, you can monitor the spatial nature of the media accurately using a pair of headphones. By default, your head position would directly face ahead within the audio sphere.

    Binauralizer Controls
    Binauralizer Controls

  8. To monitor both 360 videos at a different position, ensure that you are in the VR Viewer menu and that the viewer's controls are not hidden.  

  9. Turn the Binauralizer's Pan control until the numeric value matches the numeric value below the VR Viewer's monitor, and then turn the effect's Tilt control to match the numeric value to the right of the VR Viewer. Now you can monitor both the 360 videos.

    Note:

    After you have finished monitoring Ambisonics audio, remove or disable the Binauralizer - Ambisonics effect from the Master track in the Audio Track Mixer.  

Restaging correctly aligned video and audio

You can also reorient both the video and audio spheres to the appropriate spatial location.  

  1. Import VR video and Ambisonics audio and create a VR sequence that has these clips in it.

  2. Select Effects>VR Projection effect to the video clip in the sequence. This effect allows you to reorient the video sphere.  

    Reorienting the video sphere
    Reorienting the video sphere

  3. Select Panner>Ambisonics effect to the corresponding audio clip within this sequence. This effect allows you to reorient the audio sphere.

    Reorienting the audio sphere
    Reorienting the audio sphere

  4. Choose Effects Control>Pan, Tilt, and Roll in the VR Projection effect, and in the VR Viewer, rotate the video sphere until the video content is in its proper position.

    Using Effects Control
    Using Effects Control

  5. After positioning the video, use the same numeric values from the VR Projection effect and apply them to the Pan, Tilt, and Roll sliders in the Panner - Ambisonics effect.

    Using panner in Effects Control
    Using panner in Effects Control

Video tutorial on editing 360/VR footage in Premiere Pro

Editing 360/VR footage in Premiere Pro (Monoscopic & Stereoscopic)

Editing 360/VR footage in Premiere Pro (Monoscopic & Stereoscopic)
Watch this video to know how to edit 360/VR video in Premiere Pro

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License  Twitter™ and Facebook posts are not covered under the terms of Creative Commons.

Legal Notices   |   Online Privacy Policy