To edit 360° or 180° video, make sure your system meets the VR system requirements. If you want to use a VR headset while editing, use the supported VR headset and install the necessary software. For more information, see Configure Head Mounted Display for immersive video in Premiere Pro.
Premiere Pro offers support for viewing VR video (both 360° or 180°) in the Monitor panels. It also detects if the clip or sequence has VR properties and automatically configures the VR viewer accordingly. You can publish VR video directly to the web from Premiere Pro to sites such as YouTube or Facebook.
Editing 360/VR footage in Premiere Pro (Monoscopic & Stereoscopic)
Premiere Pro can detect if the clip or sequence has VR properties and automatically configures the VR viewer accordingly.
The VR Projection option in the Properties panel indicates whether the clip has VR properties assigned to it, and if the video is 360° or 180° video.
If the clip has VR properties assigned, you can see the following VR properties:
- VR Projection
- VR Layout
- VR Captured View
The Source Monitor and Program Monitor setting options for VR Video are disabled if your content does not have VR properties.
You would want to interpret the VR footage when:
- VR Properties are not present on a clip that is VR
- The VR Projection, VR Layout, and VR Captured View properties are present but have incorrect values assigned.
To interpret VR footage, follow these steps:
VR properties are assigned to clips when VR properties get written into the clip's metadata when it was created. If no VR properties are assigned, then there are no VR properties in the metadata associated with the clips. However, based on frame dimensions, the importer detects that it's a VR clip and interprets it as follows:
- If the frame size dimensions are 1:1, the clip is interpreted to be Stereoscopic over/under VR.
- If the dimensions are 2:1, the clip is interpreted as Monoscopic VR.
- If the dimensions are 4:1, the clip is interpreted as Stereoscopic side-by-side VR.
The auto detection is limited to specific frame heights of 960, 1920, 2048, 2880, 4096, 5760, 6000, and 8192.
To determine if a sequence has VR properties assigned to it, select the Sequence Settings screen from the Sequence menu when it is open in the Timeline panel. The Source and Program Monitor Settings options for VR Video remain disabled when a sequence that does not have VR properties is viewed.
To assign VR properties to a VR sequence, select Sequence Settings > VR Properties, and then do one of the following:
To create a sequence that includes the VR properties, select New Sequence Settings > VR Properties, and then specify the VR settings.
When sequences have VR properties associated with them, they are viewed in either the Source Monitor or the Program Monitor. The Monitor Settings menu shows the available options for VR Video available (not dimmed out).
The VR view available in the Source and Program Monitors displays scroll bars and hot-text controls for changing pan and tilt, along with a dial that supports continual pan of the VR view. You can also turn off the display of these controls if you want to maximize the video display area in Source and Program monitors.
Select Track Head-Mounted Display to link the VR view in the monitor to the view that is seen in a head-mounted VR display. This option gets highlighted when you install a VR headset along with supporting third-party plug-ins such as Mettle for Premiere Pro. Otherwise this option is disabled.
The VR properties on clips and sequences are automatically configured in Export Settings when the export Format is set to H264, HEVC, or QuickTime. You can view these Export Settings in the bottom of the Video options in the VR Video section. You can also change the settings here.
Use the dial at the bottom for 360-degree continuous panning, which indicates the direction of view.
To center the view, double click within the video frame. Use either of these methods to change the view interactively during playback and while the video is paused. To return to the normal monitor display, open the Monitor Settings menu and deselect the Enable option for VR Video.
To toggle between enabling and disabling your VR Video display use the button which can be docked with the monitor’s playback buttons. To open the button editor, click the up arrow available the lower right corner of the monitor. Drag the Toggle VR Video Display button out of the editor and move it into the monitor panel to the desired location. This button helps toggle between the normal monitor display and VR Video display.
Premiere Pro comes with several immersive video effects and transitions that you can use for your immersive videos. You can find these effects here: Video Effects > Immersive Video and Video Transitions > Immersive Video.
Here is a list of the effects and transitions that are available.
All immersive video effects and transitions can automatically detect VR properties in a clip.
You can also mix and match different resolutions and stereoscopic/monoscopic layouts in the same sequence. When you mix various equirectangular VR clips into a sequence, some match the resolution and match the stereoscopic layout while some do not. Use the VR Projection effect and choose the appropriate layout and video to properly fill the frame. In addition, you may need to correct the zero angle because of improper camera placement or subject matter focus. You can correct this by choosing to rotate the video using pan, roll, and tilt controls.
You can also play this rotation back in real time, when doing this ensure that GPU acceleration is turned on.
If you want to use the clip's VR properties, select Input Auto VR Properties. The effect uses the properties of the source clip or nested sequence on which you are placing this effect.
To manually configure the Input Layout and Input Horizontal FOV and Input Vertical FOV, disable the Input Auto VR Properties checkbox.
To define the stereoscopic/monoscopic layout of your clip that matches the VR Properties on your Source Clip (previously known as Master Clip), select VR Projection > Input Layout. For the Input Horizontal FOV and Input Vertical FOV fields, edit the values as desired.
Select Output Auto VR Properties if you want to use the properties specified by the current sequence's settings.
To manually define the desired output stereoscopic or monoscopic layout (which usually matches the VR Properties on your Sequence Output Layout), edit the Output Layout, Output Horizontal FOV, and Output Vertical FOV fields as desired.
Use the Filtering slider to improve the quality of the filtering. The Filtering slider defines how many additional samples are gathered in both the horizontal and vertical direction, decreasing aliasing artifacts.
By default, Filtering is set to 1, which reads a total of 4 samples, similar to bilinear filtering. Increasing the filtering is especially beneficial if you want to scale an image down.
(Optional): Edit Disparity Adjustment if both the input and output layouts are some form of stereoscopic.
This option allows you to shift each eye's image by a total of specified degrees.
Use a positive value to increase the stereoscopic effect and a negative value to decrease it.
Typically, you need to adjust it by very small numbers of degrees (often less than a single absolute degree), but the effect allows a full range of -180 to +180 degrees of adjustment.
This parameter is ignored if either the input or output layout is monoscopic.
Used by enthusiasts, Ambisonics is a full-sphere surround sound technique that allows users to cover sound sources above and below the listener in addition to the horizontal plane. Unlike other multichannel surround formats, its transmission channels do not carry speaker signals. Instead, they contain a speaker-independent representation of a sound field called B-format, which is then decoded to the listener's speaker setup. This extra step allows the producer to think in terms of source directions rather than loudspeaker positions, and offers the listener a considerable degree of flexibility as to the layout and number of speakers used for playback.
You can assemble Ambisonics audio along with 360 video to create an immersive experience. To check for proper alignment, you would need to monitor the Ambisonics audio as you change its orientation. The audio media could be contained in separate audio files, often in uncompressed WAV using PCM encoding, but they could also be contained in MP4 using AAC encoding.
- When you are importing multichannel mono media, import it as adaptive track audio.
- VR sequence presets are available under either the Audio Track Mixer or in the Audio Effects folder located under the Audio Effects panel.
- When you are exporting media, select Export Settings > H.264 > VR Ambisonics (choose any setting under Ambisonics as required)
You can use Premiere Pro to import Ambisonics media and accurately monitor it spatially using a pair of headphones.
Apply Binauralizer - Ambisonics effect on the Mix track (previously known as Master track) under Audio Track Mixer.
Turn the Binauralizer's Pan control until the numeric value matches the numeric value below the VR Viewer's monitor, and then turn the effect's Tilt control to match the numeric value to the right of the VR Viewer. Now you can monitor both the 360 videos.
After you have finished monitoring Ambisonics audio, remove or disable the Binauralizer - Ambisonics effect from the Mix track in the Audio Track Mixer.
There could be a delay after the uploading gets completed before the video is playable in VR mode.