Study guide

3.2 Azure AI Vision Service

Microsoft Azure AI Fundamentals AI-900

Track your progress as you read

Finished sections get a check mark.

1 Introduction

About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900

2 Domain 1: Describe AI Workloads and Considerations (15-20%)

1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure

3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)

2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service

4 Domain 3: Computer Vision Workloads on Azure (15-20%)

3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence

5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)

4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service

6 Domain 5: Generative AI Workloads on Azure (15-20%)

5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications

7 Exam Review and Full-Length Practice Questions

6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI

3.2 Azure AI Vision Service

Key Takeaways Explain This Topic AI

Azure AI Vision (formerly Computer Vision) is the primary Azure service for image analysis — it provides pre-built models for common vision tasks.

The Image Analysis 4.0 API supports image captioning, tagging, object detection, smart cropping, and people detection (background removal was retired on March 31, 2025).

Azure AI Vision OCR (Read API) extracts printed and handwritten text from images and documents with high accuracy.

Azure AI Vision's Spatial Analysis feature, which tracked people moving through physical spaces in camera video, was retired on March 30, 2025; Azure AI Video Indexer handles current video analysis.

You access Azure AI Vision through the REST API or SDKs — no custom model training is needed for pre-built capabilities.

Last updated: October 2026

Quick Answer: Azure AI Vision is the primary Azure service for image analysis. It provides pre-built models for image captioning, tagging, object detection, OCR, people detection, and more. No custom model training is needed — you send an image to the API and receive analysis results.

What Is Azure AI Vision?

Azure AI Vision (formerly known as Azure Computer Vision) is a cloud-based service that provides pre-built computer vision capabilities. You send images to the service, and it returns structured analysis results.

Key Capabilities

  • Capability Description Example Output
  • Image captioning Generate a natural language description of an image "A dog playing fetch in a park"
  • Image tagging Assign descriptive tags to an image ["dog", "outdoor", "park", "grass", "playing"]
  • Object detection Identify and locate objects with bounding boxes Object: "dog" at [100, 200, 150, 180]
  • Smart cropping Automatically crop images around regions of interest Focused crop around the main subject
  • People detection Detect and locate people in images Person locations with bounding boxes
  • OCR (Read) Extract printed and handwritten text "Invoice #12345, Date: March 2026"
  • Image Analysis 4.0 API

The latest version of the Image Analysis API (4.0) is powered by Florence , a large-scale vision foundation model. Key improvements include:

  • Better captioning — more natural and accurate image descriptions
  • Dense captioning — descriptions for multiple regions in an image
  • Image retrieval — search through images using text queries (vector search)

Customization (retired) — Image Analysis 4.0 custom models were retired on March 31, 2025; train a custom image model with Azure AI Custom Vision

  • How to Use Image Analysis
  • Create an Azure AI Vision resource in the Azure portal
  • Send an image to the REST API or use the SDK
  • Specify which visual features you want (caption, tags, objects, etc.)
  • Receive structured JSON results Request: POST /imageanalysis:analyze?features=caption,tags,objects
  • Image: [photo of a park scene]

Response:

  • {
  • "caption": "A golden retriever playing fetch in a sunny park",
  • "tags": ["dog", "golden retriever", "park", "grass", "ball", "outdoor"],
  • "objects": [
  • {"name": "dog", "confidence": 0.97, "boundingBox": {...}},
  • {"name": "ball", "confidence": 0.89, "boundingBox": {...}}
  • ]
  • }

On the Exam: Know that Azure AI Vision provides PRE-BUILT capabilities — you do not need to train a model. Send an image, get results. If a question asks about training a custom image model, that is Azure AI Custom Vision (different service).

OCR with the Read API

The Read API is Azure AI Vision's OCR capability for extracting text from images and documents:

  • Supported Content
  • Printed text in 164+ languages
  • Handwritten text in English, Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish
  • Mixed content — images with both printed and handwritten text
  • Document formats — JPEG, PNG, BMP, PDF, TIFF
  • Read API Process
  • Submit an image or document to the Read API
  • The service processes the image asynchronously
  • Retrieve results with extracted text, line positions, and word positions
  • Results include confidence scores for each extracted word
  • Common OCR Use Cases
  • Digitizing paper documents and forms
  • Reading license plates from camera images
  • Extracting data from receipts and invoices
  • Converting handwritten notes to searchable text
  • Indexing text in image-heavy documents
  • Retired: Spatial Analysis

Spatial Analysis used camera video on an Azure IoT Edge device to count people and track how they moved through a space. Microsoft retired it on March 30, 2025 , so it is not a current Azure AI Vision capability. For recorded video, use Azure AI Video Indexer .

When to Use Azure AI Vision vs. Other Services

  • Scenario Service to Use
  • Analyze a single image for tags, captions, objects Azure AI Vision
  • Extract text from a scanned document Azure AI Vision (Read API) or Azure AI Document Intelligence
  • Train a custom image classifier with your own categories Azure AI Custom Vision
  • Detect and verify human faces Azure AI Face
  • Generate images from text descriptions Azure OpenAI Service (gpt-image models)
  • Analyze video for scene detection and transcription Azure AI Video Indexer
  • Extract structured data from forms and invoices Azure AI Document Intelligence