Learn how to design and prototype using voice commands, speech playback, and audio playback.

Adobe XD provides an easy-to-use solution that lets you use voice commands to trigger an interaction between artboards or component states. Like using a Click or a Tap as a Trigger, you can use Voice Commands to trigger a prototype interaction and Speech Playback, Audio Playback, and Scroll To as triggered actions. For example, if you are integrating voice search within a mobile application, you can use Voice Commands and Speech Playback to automatically transition between artboards. For better scrolling capabilities within the design, you can use Scroll To to set anchor links and navigate to specific sections on an artboard.

Add a voice command to a prototype

  1. Switch to the Prototype tab.

  2. To define an interaction, click the blue connector on the source object, component state, or artboard. Set the following options in the Property Inspector:

    • Trigger: Set to Voice.
    • Command: Enter the Voice Command as text.
    • Action: Set to Transition.
    • Destination: Set the destination artboard or component state.
    • Animation: Set animations based on the available options.
    • Easing: Set easing based on the available options.
    • Duration: Set duration in Seconds.
    Set voice triggers
    Set voice triggers for artboards

    A. Set Trigger to Voice B. Enter voice command as text 



    Set voice triggers for component states
    Set voice triggers for component states

    A. Set Trigger to Voice B. Enter voice command as text C. Set Destination to a component state 
  3. To define more than one interaction for an object, component state, or artboard:

    1. Select it and click the + button on the artboard. Alternatively, you can also click the + button in the Property Inspector.
    2. Set the properties in the Property Inspector.

     Remember that you can apply Tap, Drag, Hover, and Time triggers once, and VoiceKeys & Gamepad many times. 

    Use multiple triggers to define more interactions
  4. To view the changes you have updated, select the Desktop Preview icon .

  5. To preview the transition to the next artboard or component state, hold down the spacebar and repeat the voice command. 

Add playback to a prototype

Add an audio playback

Use the Audio playback action to add sound effects to your prototypes. For example, an audio confirmation after the successful delivery of an email. You can import an audio as an MP3 or a WAV file.

To add audio playback on an object or artboard, perform the following steps:

  1. In the Prototype mode, select the object or the artboard.

  2. In the Property Inspector, set the following options:

    • Click + to add the interaction. 
    • Trigger: set to Tap.
    • Action: set to Audio Playback, and then browse and add the audio file. 

     Audio playback in a Prototype link for a Safari browser works only if you have set auto-play in the browser’s setting.

Add multiple actions from a single trigger

You can add a non-transitional action such as an Audio playback with a primary transitional action such as Transition or Auto-Animate. For example, a mouse-clicking sound when you transition from one artboard to another.

To add multiple actions to your prototype, perform the following steps:

  1. In the Prototype mode, select the object or the artboard on which you want to add multiple actions. 

  2. In the Property Inspector, set the following options:

    • Click + to add the interaction. 
    • Trigger: set to Tap.
    • Set the first Action + button (transitional action) to Transition, Auto-Animate, Overlay, Scroll To, or Previous artboard
    • Set the second Action + button (non-transitional action) to Audio playback or Speech playback
    Set multiple actions to an object or an artboard

     The second Action + button in the Property Inspector is enabled only when you set Tap as the trigger. In addition, if you set a non-transitional action such as Audio playback or Speech playback as the first action, the second Action + button is not enabled.

Add a speech playback

Use speech playback to add a voice playback to your prototypes.

To add speech playback on an object or an artboard, perform the following steps:

  1. Drag the wire from the source artboard to the destination artboard.

  2. To add a speech playback, in the Property Inspector, set the following options:

    • Trigger: set to Time.
    • Time delay: set the time delay (in seconds) to define when the speech playback should execute. 
    • Action: set it to Speech Playback.
    • Voice: choose a voice for the speech playback.
    • Speech: type in the text you want to playback.
    Use speech playback
    Use speech playback

    A. Set Trigger to Time B. Set Time Delay in Seconds C. Set Action to Speech Playback D. Set voice  E. Add the Speech Response 
  3. To preview the changes, select the Desktop Preview icon .

  4. To preview the speech playback transition to the next artboard, hold down the spacebar and repeat the voice command. 

    Preview speech playback
    Preview speech playback

Add a voice narration to a prototype

  1. In the Prototype mode, select the Home screen where the start of the flow is set and click the Desktop Preview button.

     Mac users have the option to enable the microphone before starting a preview recording; Windows users can enable this through an OS-level control in Gamecenter.

  2. Select the drop-down arrow next to the record button and select Enable the microphone option. When recording, watch out for the red icon that flashes on the interface.

  3. You can save the recording as an mp4 and share it with your stakeholders or post it in social media. 

     This doesn't actually directly capture audio output from XD, such as speech playback. The mic overhears or records the output depending on the user setup (the system mic would hear the system speakers play the speech playback).

Share and review the prototype or design specs link on the web

  1. In the desktop app, click the Share icon at the upper right and choose Share for Review (for prototypes) or Share for Development (for design specs).

  2. When previewing a prototype on a:

    • Desktop or laptop: hold down the spacebar.
    • Adobe XD Mobile app (iOS/Android): use a long press gesture anywhere on the screen. Place your finger on the screen (without moving it) and use the voice command before lifting your finger back.
    • Mobile browser in a smartphone: hold down the microphone icon located in the lower right-corner of the screen.
  3. When previewing design specs, developers can read or view the voice commands and speech playback as text. 

     Design specs do not support voice interactions.

Troubleshoot voice interactions using notifications

You can now troubleshoot voice triggered interactions during prototype previews on the desktop or web. Stakeholders, who review the design specs can also use this feature to better understand how to interact with your prototype in Adobe XD.

Before talking to your prototype during preview, ensure that the Show Notifications menu option is checked. By default, this menu option is in checked state when you launch Adobe XD.

Show notifications
Show notifications for voice prototype

Each command you speak to Adobe XD is matched against all of the voice triggers present on that current artboard or component state. If no match is found, you will receive a notification stating No match found for: {the command you spoke}. Seeing what Adobe XD heard helps you determine why a match is not being made each time you speak.

There can be different reasons a match can’t be found. Perhaps the voice command spoken isn’t being used in any interactions on that artboard or component state. Or maybe the speech-to-text service is returning an unexpected result.

For example, you may decide to add the phrase two dollars as a voice command in an interaction. But when spoken, the speech-to-text service may return a result of $2.00. By seeing this in the notification, you will now know to change the interaction to use numerals instead of words.