Import 360° or 180° media into Premiere Pro, edit your project, then share your video in monoscopic or stereoscopic format. While editing, monitor your project on-screen, or with a VR headset.
To edit 360° or 180° video, make sure your system meets the VR system requirements. If you want to use a VR headset while editing, use the supported VR headset and install the necessary software. For more information, see Configure Head Mounted Display for immersive video in Premiere Pro.
Premiere Pro offers support for viewing VR video (both 360° or 180°) in the Monitor panels. It also detects if the clip or sequence has VR properties and automatically configures the VR viewer accordingly. You can publish VR video directly to the web from Premiere Pro to sites such as YouTube or Facebook.
Premiere Pro can detect if the clip or sequence has VR properties and automatically configures the VR viewer accordingly.
To determine if a clip has VR properties assigned to it:
Select the clip in the Project Panel, click File > Get Properties for > Selection.
The VR Projection option in the Properties panel indicates whether the clip has VR properties assigned to it, and if the video is 360° or 180° video.
If the clip has VR properties assigned, you can see the following VR properties:
The Source Monitor and Program Monitor setting options for VR Video are disabled if your content does not have VR properties.
You would want to interpret the VR footage when:
To interpret VR footage, follow these steps:
Right-click the clip in the Project Panel and select Modify > Interpret Footage.
Specify the appropriate settings in VR Properties.
VR properties are assigned to clips when VR properties get written into the clip's metadata when it was created. If no VR properties are assigned, then there are no VR properties in the metadata associated with the clips. However, based on frame dimensions, the importer detects that it's a VR clip and interprets it as follows:
The auto detection is limited to specific frame heights of 960, 1920, 2048, 2880, 4096, 5760, 6000, and 8192.
To determine if a sequence has VR properties assigned to it, select the Sequence Settings screen from the Sequence menu when it is open in the Timeline panel. The Source and Program Monitor Settings options for VR Video remain disabled when a sequence that does not have VR properties is viewed.
To assign VR properties to a VR sequence, select Sequence Settings > VR Properties, and then do one of the following:
In the Project panel, right-click the clip that has VR properties.
From the pop-up menu, select New Sequence From Clip.
To create a sequence that includes the VR properties, select New Sequence Settings > VR Properties, and then specify the VR settings.
In the Project panel, right-click the sequence.
From the pop-up menu, select Sequence Settings.
In the VR Properties section, specify the VR settings.
When sequences have VR properties associated with them, they are viewed in either the Source Monitor or the Program Monitor. The Monitor Settings menu shows the available options for VR Video available (not dimmed out).
The VR view available in the Source and Program Monitors displays scroll bars and hot-text controls for changing pan and tilt, along with a dial that supports continual pan of the VR view. You can also turn off the display of these controls if you want to maximize the video display area in Source and Program monitors.
To turn off the controls, select VR Video > Hide Controls from the Source or Program Monitors Settings menu.
You could also map this option to a keyboard shortcut. The state of control is available for each monitor and they are saved with the project.
Select Track Head-Mounted Display to link the VR view in the monitor to the view that is seen in a head-mounted VR display. This option gets highlighted when you install a VR headset along with supporting third-party plug-ins such as Mettle for Premiere Pro. Otherwise this option is disabled.
The VR properties on clips and sequences are automatically configured in Export Settings when the export Format is set to H264, HEVC, or QuickTime. You can view these Export Settings in the bottom of the Video options in the VR Video section. You can also change the settings here.
Use the dial at the bottom for 360-degree continuous panning, which indicates the direction of view.
To center the view, double click within the video frame. Use either of these methods to change the view interactively during playback and while the video is paused. To return to the normal monitor display, open the Monitor Settings menu and deselect the Enable option for VR Video.
To toggle between enabling and disabling your VR Video display use the button which can be docked with the monitor’s playback buttons. To open the button editor, click the up arrow available the lower right corner of the monitor. Drag the Toggle VR Video Display button out of the editor and move it into the monitor panel to the desired location. This button helps toggle between the normal monitor display and VR Video display.
Premiere Pro comes with several immersive video effects and transitions that you can use for your immersive videos. You can find these effects here: Video Effects > Immersive Video and Video Transitions > Immersive Video.
Here is a list of the effects and transitions that are available.
All immersive video effects and transitions can automatically detect VR properties in a clip.
You can also mix and match different resolutions and stereoscopic/monoscopic layouts in the same sequence. When you mix various equirectangular VR clips into a sequence, some match the resolution and match the stereoscopic layout while some do not. Use the VR Projection effect and choose the appropriate layout and video to properly fill the frame. In addition, you may need to correct the zero angle because of improper camera placement or subject matter focus. You can correct this by choosing to rotate the video using pan, roll, and tilt controls.
You can also play this rotation back in real time, when doing this ensure that GPU acceleration is turned on.
If you want to clip to be scaled to fill the frame regardless of aspect ratio or frame size, select VR Projection > Stretch To Fill frame.
If you want to use the clip's VR properties, select Input Auto VR Properties. The effect uses the properties of the source clip or nested sequence on which you are placing this effect.
To manually configure the Input Layout and Input Horizontal FOV and Input Vertical FOV, disable the Input Auto VR Properties checkbox.
To define the stereoscopic/monoscopic layout of your clip that matches the VR Properties on your Source Clip (previously known as Master Clip), select VR Projection > Input Layout. For the Input Horizontal FOV and Input Vertical FOV fields, edit the values as desired.
Select Output Auto VR Properties if you want to use the properties specified by the current sequence's settings.
To manually define the desired output stereoscopic or monoscopic layout (which usually matches the VR Properties on your Sequence Output Layout), edit the Output Layout, Output Horizontal FOV, and Output Vertical FOV fields as desired.
Use the Filtering slider to improve the quality of the filtering. The Filtering slider defines how many additional samples are gathered in both the horizontal and vertical direction, decreasing aliasing artifacts.
By default, Filtering is set to 1, which reads a total of 4 samples, similar to bilinear filtering. Increasing the filtering is especially beneficial if you want to scale an image down.
(Optional): Edit Disparity Adjustment if both the input and output layouts are some form of stereoscopic.
This option allows you to shift each eye's image by a total of specified degrees.
Use a positive value to increase the stereoscopic effect and a negative value to decrease it.
Typically, you need to adjust it by very small numbers of degrees (often less than a single absolute degree), but the effect allows a full range of -180 to +180 degrees of adjustment.
This parameter is ignored if either the input or output layout is monoscopic.
To view the left to right orientation of the sphere, select VR Projection > Pan.
To view the bottom to top orientation of the sphere, select VR Projection > Tilt.
To view the counter-clockwise to clockwise orientation of the sphere, select VR Projection > Roll.
Used by enthusiasts, Ambisonics is a full-sphere surround sound technique that allows users to cover sound sources above and below the listener in addition to the horizontal plane. Unlike other multichannel surround formats, its transmission channels do not carry speaker signals. Instead, they contain a speaker-independent representation of a sound field called B-format, which is then decoded to the listener's speaker setup. This extra step allows the producer to think in terms of source directions rather than loudspeaker positions, and offers the listener a considerable degree of flexibility as to the layout and number of speakers used for playback.
You can assemble Ambisonics audio along with 360 video to create an immersive experience. To check for proper alignment, you would need to monitor the Ambisonics audio as you change its orientation. The audio media could be contained in separate audio files, often in uncompressed WAV using PCM encoding, but they could also be contained in MP4 using AAC encoding.
You can use Premiere Pro to import Ambisonics media and accurately monitor it spatially using a pair of headphones.
Select File > New Sequence > Sequence Presets > VR.
Choose VR > Monoscopic 29.97 > 2048x2048 - Ambisonics or VR > Stereoscopic 29.97 > 2048x2048.
Create a sequence containing multi-channel Ambisonics audio.
Apply Binauralizer - Ambisonics effect on the Mix track (previously known as Master track) under Audio Track Mixer.
All three controls have a range of -180 to +180 degrees.
To monitor in a different direction, click the knob control of the effect and change the left-to-right Pan.
Click the control enumeration menu at the bottom of the effect. Click to change Tilt to listen upward or downward, or use Roll to rotate your head clockwise or counter-clockwise.
After you apply the effect, you can monitor the spatial nature of the media accurately using a pair of headphones. By default, your head position would directly face ahead within the audio sphere.
To monitor both 360 videos at a different position, ensure that you are in the VR Viewer menu and that the viewer's controls are not hidden.
Turn the Binauralizer's Pan control until the numeric value matches the numeric value below the VR Viewer's monitor, and then turn the effect's Tilt control to match the numeric value to the right of the VR Viewer. Now you can monitor both the 360 videos.
After you have finished monitoring Ambisonics audio, remove or disable the Binauralizer - Ambisonics effect from the Mix track in the Audio Track Mixer.
You can also reorient both the video and audio spheres to the appropriate spatial location.
Import VR video and Ambisonics audio and create a VR sequence that has these clips in it.
Select Effects>VR Projection effect to the video clip in the sequence. This effect allows you to reorient the video sphere.
Select Panner>Ambisonics effect to the corresponding audio clip within this sequence. This effect allows you to reorient the audio sphere.
Choose Effects Control>Pan, Tilt, and Roll in the VR Projection effect, and in the VR Viewer, rotate the video sphere until the video content is in its proper position.
After positioning the video, use the same numeric values from the VR Projection effect and apply them to the Pan, Tilt, and Roll sliders in the Panner - Ambisonics effect.
To publish your VR Video on websites such as YouTube and Facebook:
Select Export Settings >Video Settings tab.
Encode the video using H.264, HEVC, or QuickTime formats.
Scroll down to check that the Video is VR check box and choose the layout which matches your media from the pop-up menu. Based on the metadata that gets added to the encoded video, Premiere Pro recognizes the video as VR Video content for publishers to play back correctly.
Use the Stretch to Fill Scaling setting under Export Settings to get the best results for VR video exports.
Select Export Settings > Publish dialog to upload this video directly to websites such as YouTube or Facebook.
There could be a delay after the uploading gets completed before the video is playable in VR mode.