Generate sound effects using your voice as a guide

Last updated on Sep 11, 2025

Learn how to use the Voice to sound effects feature to generate sound effects using your voice as a guide.

Launch the Firefly app and tap Generate sound effects (beta).

On the Generate SFX screen, use the Upload button to add a video or an audio clip to the timeline where you want to apply sound effects.

A video is uploaded and is added to the timeline. It has the Generate sound effects button available. The Upload option is highlighted.
Use the Upload option to add a video to the timeline and generate a sound effect.

Note
  • The uploaded file should be a maximum of 30 seconds long.
  • Currently, .mp4, .mp3, .mov, .wav, and .aac formats are supported. 

Scroll through the timeline and place the playhead at the exact position where you want to generate and insert the sound effect.

Tap the Generate sound effects button and select the Timed sound with your video option from the available options.

The Generate sound effects option has two different options and the Timed sound with your video option is selected from the available options.
Use the Timed sound with your video option to record or upload an audio clip and generate sound effects for your video.

In the prompt bar, add a text description of the sound effect you want to generate and select one of the following:

  • From Device: Upload an audio clip with a voice recording to use for sound effect generation.
  • Record Timing: Record your voice directly to generate sound effects.
Timed sound with your video has a text prompt with the options to upload an audio file from the device or record it directly on the web app.
Use the Record timing option to directly record your voice so the generated sound effect matched the timing of the recording.

Once the voice is recorded, you can play it to review, re-record, or select Generate to start generating sound effects.

The Record timing screen displays the uploaded video, a text prompt, and options to review, record, or generate sound effects.
Go through the recorded voice clip, then either re-record or generate the sound effects.

Play and preview the generated variations and select the one you want, and then tap Add sound effects.

The Short Sound Variations option is open, and four different generated variations are available to choose from. There is also an option to add the sound effects to the timeline.
Go through the generated variations and add one of the generated sound effects to the timeline.

Select a sound effect on the timeline to mute, adjust volume, download, rename, or delete it. To trim, drag the ends inward and reposition the clip as needed.

You can place the playhead on the same track to add another sound effect using the prompt bar. Or, for layered audio, add a new track using the    icon and generate a sound effect there.

Play and preview the final composition, then tap the menu   icon to access the download option.

The Download option is highlighted so you can download the composed audio or video clip.
Use the Download option to download the composed video clip.