Voice capabilities in Adobe XD let you take users beyond the screen. Learn how to design and prototype using voice commands and speech playback.
Voice capabilities in Adobe XD allow designers to incorporate the medium of voice into their prototypes and design rich experiences such as integrating voice search within a mobile application, adding a speech output for turn-by-turn directions in a car navigation system, or including both into an interactive kiosk in retail environments.
Adobe XD uses voice commands to seamlessly integrate voice into prototyping workflows so that designers can be involved in the early creation stages of voice applications.
Voice commands allow you to trigger an interaction using a verbal command. Similar to using a Click or Tap as a Trigger, you can add a specific utterance as a trigger within XD’s prototyping mode. Speech Playback gives you access to a powerful text-to-speech engine that you can use to interact with your prototype.
Ability to design, prototype, and share experiences using the medium of voice.
Create experiences for new platforms and devices, such as voice assistants and smart speakers.
Ease of use in adding voice like any other prototyping interaction with no previous experience in voice technology or coding.
Adobe XD requires access to the microphone of the device it is being used on.
Ensure that the speakers are enabled and set to an appropriate volume level to hear any speech playback incorporated into your prototype.
While voice command and speech playback features of Adobe XD are translated to all localized versions of XD, voice command and speech playback capabilities are available in English, German, Japanese, Korean, Chinese, Spanish, Brazilian Portuguese, and French. Do note that these capabilities are based on the Language and Region settings on your computer.
Speech detection has been optimized for accents and speech playback offers a wider variety of voices with accents based on your region.
Voice prototyping is a quickly evolving technology with new devices entering the market all the time. A few examples of voice prototyping with Adobe XD include:
Some of the workflows are:
For information on how to create, publish, and preview a voice prototype and speech playback response, see Create prototypes using voice commands.
When previewing a prototype on a:
Assuming that you have set up the voice command in a proper manner, check your mic settings to ensure that Adobe XD has permissions to access your microphone.
Adobe XD does its best to match what is said to the available set of commands. Though it does not need an exact mapping, how close it should be varies for different phrases. A significant part of working with voice is testing how Adobe XD handles different phrases in your design.
Ensure that your device is not muted, and the volume is turned up. A good way to validate speech playback is to enter the prototyping mode, add an interaction to an object that uses a tap trigger and speech playback. In the preview mode, click the object to hear the speech playback.
Some wireless headphones may not work properly with voice triggers and speech playback. If you are having issues, try disconnecting your wireless headphones.
To learn more about voice triggers in XD, watch this video.
Viewing time: 9 minutes