Learn how to design and prototype using voice commands and speech playback.

Adobe XD provides an easy-to-use solution that lets you use voice commands to trigger an interaction between artboards. Like using a Click or a Tap as a Trigger, you can use Voice Commands to trigger a prototype interaction and Speech Playback as a triggered action. For example, if you are integrating voice search within a mobile application, you can use Voice Commands and Speech Playback to automatically transition between artboards.

Add a voice command to a prototype

  1. In XD, switch to Prototype mode.

  2. Select all the artboards on the canvas to view their wires.

  3. Click and drag the wires from the source artboard to the destination artboard. When you wire up the first element, the artboard of that element is set as the home artboard.

  4. In the Trigger head-up display, set the following options to trigger a voice prototype interaction:

    • Trigger: set to Voice.
    • Command: enter the Voice Command as text.
    • Action: set to Transition.
    • Destination: set the destination artboard.
    • Animation: set animations based on the available options.
    • Easing: set easing based on the available options.
    • Duration: set duration in Seconds.
    Set voice triggers
    Set voice triggers

    A. Set Trigger to Voice B. Enter Voice Command as a text 
  5. To preview the changes, select the Desktop Preview icon .

  6. To preview the transition to the next artboard, hold down the spacebar and repeat the voice command. 

    Preview transition with a voice command
    Preview transition with a voice command

Add a speech playback to a voice input

  1. Click and drag the wire from the destination artboard to the source artboard.

  2. In the Trigger head-up display, set the following options:

    • Trigger: set to Time.
    • Time delay: set the transition delay period in Seconds.
    • Action: set it to Speech Playback.
    • Speech: add the corresponding speech response.
    Use speech playback
    Use speech playback

    A. Set Trigger to Time B. Set Time Delay in Seconds C. Set Action to Speech Playback D. Add the Speech Response 
  3. To preview the changes, select the Desktop Preview icon .

  4. To preview the transition to the next artboard, hold down the spacebar and repeat the voice command. 

    Preview speech playback
    Preview speech playback

Add a voice narration to a prototype

  1. In the Prototype mode, select the Home screen where the start of the flow is set and click on the Desktop Preview button.

    Note:

    MAC users have the option to enable the microphone before starting a preview recording; Windows users can enable this through an OS-level control in Gamecenter.

  2. Select the drop-down arrow adjacent to the record button and select Enable the microphone option. When recording, watch out for the red icon that flashes on the interface.

  3. You can save the recording as an mp4 and share it with your stakeholders or post it in social media. 

Share and review the prototype or design specs link on the web

  1. In the desktop app, click the Share icon at the upper right and choose Share for Review (for prototypes) or Share for Development (for design specs).

  2. When previewing a prototype on a:

    • Desktop or laptop: hold down the spacebar.
    • Adobe XD Mobile app (iOS/Android): use a long press gesture anywhere on the screen. Place your finger on the screen (without moving it) and use the voice command before lifting your finger back.
    • Mobile browser in a smartphone: hold down the microphone icon located in the lower right-corner of the screen.
  3. When previewing design specs, developers can read or view the voice commands and speech playback as text. 

    Note:

    Design specs do not support voice interactions.

Troubleshoot voice interactions using notifications

You can now troubleshoot voice triggered interactions during prototype previews on the desktop or web. Stakeholders, who review the design specs can also use this feature to better understand how to interact with your prototype in Adobe XD.

Before talking to your prototype during preview, ensure the Show Notifications menu item is checked. By default, this menu item is in checked state when you launch Adobe XD.

Show notifications
Show notifications for voice prototype

Each command you speak to Adobe XD is matched against all of the voice triggers present on that current artboard. If no match is found, you will receive a notification stating No match found for: {the command you spoke}. Seeing what Adobe XD heard helps you determine why a match is not being made each time you speak.

There can be different reasons a match can’t be found. Perhaps the voice command spoken isn’t being used in any interactions on that artboard. Or maybe the speech-to-text service is returning an unexpected result.

For example, you may decide to add the phrase two dollars as a voice command in an interaction. But when spoken, the speech-to-text service may return a result of $2.00. By seeing this in the notification, you will now know to change the interaction to use numerals instead of words.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License  Twitter™ and Facebook posts are not covered under the terms of Creative Commons.

Legal Notices   |   Online Privacy Policy