Study guide

4.3 Azure AI Speech Service

Microsoft Azure AI Fundamentals AI-900

Track your progress as you read

Finished sections get a check mark.

1 Introduction

About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900

2 Domain 1: Describe AI Workloads and Considerations (15-20%)

1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure

3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)

2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service

4 Domain 3: Computer Vision Workloads on Azure (15-20%)

3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence

5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)

4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service

6 Domain 5: Generative AI Workloads on Azure (15-20%)

5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications

7 Exam Review and Full-Length Practice Questions

6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI

4.3 Azure AI Speech Service

Key Takeaways Explain This Topic AI

Azure AI Speech provides speech-to-text (STT), text-to-speech (TTS) and speech translation via the Speech SDK and REST APIs; Speaker Recognition was retired on September 30, 2025.

Speech-to-text supports real-time and batch transcription, custom speech for domain vocabulary, and speaker diarization to separate speakers.

Text-to-speech uses 600+ neural voices across 150+ languages/locales, supports SSML for fine control, and offers gated custom neural voice.

Speech translation runs recognize -> translate -> (optionally) synthesize, so it can output translated text or translated speech.

Speaker diarization separates who spoke when in a transcript but does not identify the speakers; Speaker Recognition, which verified or identified people by voice, was retired on September 30, 2025.

Last updated: October 2026

Quick Answer: Azure AI Speech provides three core capabilities: speech-to-text (convert audio to text), text-to-speech (convert text to audio), and speech translation (translate spoken language). All are available via REST APIs and the Speech SDK. Speaker Recognition (identifying who is speaking) was retired on September 30, 2025.

What Is Azure AI Speech?

Azure AI Speech is a cloud-based service that provides a comprehensive set of speech-related AI capabilities. It handles the audio side of NLP — converting between speech and text, translating spoken language, and separating speakers in a transcript. Where Azure AI Language works on text, Azure AI Speech works on the spoken word.

  • Core Capabilities
  • 1. Speech-to-Text (STT)

What it does: Converts spoken audio into written text (transcription).

  • Feature Description
  • Real-time transcription Transcribe audio as it is spoken (live captioning, voice commands)
  • Fast / batch transcription Transcribe pre-recorded audio files (meeting recordings, podcasts)
  • Custom speech Train on your vocabulary and acoustic environment for better accuracy
  • Multi-language Supports 100+ languages and dialects
  • Speaker diarization Separate speakers in a conversation ("Speaker 1:", "Speaker 2:")

Use cases: live meeting captioning, voice-controlled apps, call-center transcription for quality analysis, accessibility captioning for deaf or hard-of-hearing users, and dictation.

2. Text-to-Speech (TTS)

What it does: Converts written text into natural-sounding speech audio using neural voices .

  • Feature Description
  • Neural voices 600+ natural-sounding prebuilt voices across 150+ languages and locales

Custom neural voice Create a unique voice for your brand (limited/gated access, requires responsible-AI review)

  • SSML support Fine-tune pronunciation, pitch, rate, and emphasis using Speech Synthesis Markup Language
  • Visemes Synchronized mouth shapes for animated avatars

Use cases: screen readers and accessibility tools, audiobook generation, Interactive Voice Response (IVR) systems, voice-enabled chatbots, e-learning narration, and public-announcement systems.

Two voice tiers worth knowing: standard neural voices (the broad prebuilt catalog) and newer high-definition (HD) / Dragon HD voices that add greater expressiveness and emotional range. For the exam, the headline fact is simply that TTS uses neural voices that sound human, not the older robotic concatenative voices.

3. Speech Translation

What it does: Translates spoken audio from one language to another, in near real time.

  • Feature Description
  • Speech-to-text translation Spoken language -> translated text
  • Speech-to-speech translation Spoken language -> translated spoken audio
  • Multi-language Many languages supported for speech translation
  • Real-time Near-instant translation for live conversations

How it works — three steps:

  • Recognize the spoken input (speech-to-text)
  • Translate the recognized text to the target language
  • Synthesize the translated text (text-to-speech) — only for speech-to-speech translation

Use cases: real-time translation in international meetings, travel assistance (speak in your language, output in the local language), multilingual customer service, and cross-language collaboration tools.

Retired: Speaker Recognition

Speaker Recognition identified or verified a person by voice (verification was 1:1, identification 1:many). Microsoft retired it on September 30, 2025, so apps can no longer use it. Speaker diarization in speech-to-text still separates who spoke when, but it labels speakers generically rather than identifying them.

Custom Speech Models

Azure AI Speech can be customized for better accuracy in specific environments:

Customization What It Does When to Use

Custom speech-to-text Train on your domain vocabulary and acoustic conditions Medical, legal, or technical terminology

  • Custom neural voice Create a unique branded voice Brand identity, specific character voices
  • Pronunciation assessment Evaluate speech pronunciation accuracy Language-learning applications

A common exam scenario: a hospital wants accurate transcription of drug names and clinical terms. The default model struggles with rare vocabulary, so the answer is custom speech — train on the domain words, not switch services.

Azure AI Speech vs. Azure AI Language

  • Aspect Azure AI Speech Azure AI Language
  • Input Audio / speech Text
  • Primary tasks STT, TTS, speech translation Sentiment, NER, key phrases, CLU
  • Focus Converting between audio and text Understanding text meaning

The two are often chained : Speech converts a caller's audio to text -> Language analyzes intent and sentiment -> a response is generated -> Speech converts the response back to audio. Knowing this pipeline answers many "which combination of services?" questions.

Common Exam Scenarios

  • Scenario Capability
  • Add live captions to a webinar Speech-to-text (real-time)
  • Read web content aloud for accessibility Text-to-speech
  • Build an IVR phone menu with a natural voice Text-to-speech (often with SSML)
  • Translate a spoken conversation between two people Speech translation
  • Transcribe a podcast archive overnight Speech-to-text (batch)
  • Improve recognition of legal jargon Custom speech

A subtle distinction the exam likes: speech translation (audio in, translated text or audio out) lives in Azure AI Speech, whereas Azure AI Translator only handles text. If the input is spoken, think Speech; if the input is written, think Translator.

On the Exam: Speech handles audio-to-text and text-to-audio conversions; Language analyzes text. Speech translation (audio) is different from Azure AI Translator (text). Speaker Recognition was retired on September 30, 2025; diarization separates speakers but does not identify them.