Study guide

3.1 Computer Vision Concepts and Tasks

Microsoft Azure AI Fundamentals AI-900

Track your progress as you read

Finished sections get a check mark.

1 Introduction

About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900

2 Domain 1: Describe AI Workloads and Considerations (15-20%)

1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure

3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)

2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service

4 Domain 3: Computer Vision Workloads on Azure (15-20%)

3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence

5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)

4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service

6 Domain 5: Generative AI Workloads on Azure (15-20%)

5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications

7 Exam Review and Full-Length Practice Questions

6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI

3.1 Computer Vision Concepts and Tasks

Key Takeaways Explain This Topic AI

Computer vision enables AI to interpret and extract information from images and videos — it is how machines "see."

Image classification assigns a single label to an entire image (e.g., "cat" or "dog"); it answers "What is in this image?"

Object detection identifies AND locates objects within an image using bounding boxes — it answers "Where are objects in this image?"

Semantic segmentation classifies every pixel in an image, creating a detailed map of what is where — used in autonomous driving.

OCR (Optical Character Recognition) extracts text from images, converting visual text into machine-readable text.

Last updated: October 2026

Quick Answer: Computer vision enables machines to interpret images and videos. The key tasks are image classification (label an entire image), object detection (find and locate objects with bounding boxes), semantic segmentation (classify every pixel), OCR (extract text from images), and facial analysis (detect and analyze faces). Each task answers a different question about the visual content.

What Is Computer Vision?

Computer vision is a field of AI that enables computers to interpret and extract meaningful information from visual data — images and videos. It is how machines "see" and understand the visual world.

Computer vision powers applications you use every day:

  • Unlocking your phone with your face
  • Depositing checks by photographing them
  • Self-driving cars navigating roads
  • Security cameras detecting intruders
  • Medical imaging detecting tumors
  • Barcode and QR code scanning
  • Core Computer Vision Tasks

Understanding the differences between these tasks is critical for the AI-900:

1. Image Classification

What it does: Assigns a single label to an entire image.

Question it answers: "What is in this image?"

Output: A class label with a confidence score.

  • Input Image Predicted Label Confidence
  • Photo of a golden retriever "Dog" 95.2%
  • Photo of a tabby cat "Cat" 98.7%
  • Chest X-ray "Pneumonia" 87.3%
  • Satellite image "Urban" 91.5%

Use cases:

  • Medical image screening (disease vs. healthy)
  • Quality inspection in manufacturing (defective vs. acceptable)
  • Content moderation (appropriate vs. inappropriate)
  • Wildlife monitoring (species identification)
  • Plant disease detection (healthy vs. infected)
  • 2. Object Detection

What it does: Identifies AND locates multiple objects within an image using bounding boxes.

Question it answers: "What objects are in this image, and where are they?"

Output: A list of detected objects, each with a class label, confidence score, and bounding box coordinates (x, y, width, height).

Input Image Detected Objects

Street scene Car (0.97) at [120, 200, 300, 180], Person (0.93) at [450, 150, 80, 200], Dog (0.85) at [600, 350, 60, 50]

Grocery shelf Apple (0.99) at [50, 100, 80, 80], Banana (0.96) at [200, 100, 120, 40]

Use cases:

  • Autonomous vehicles (detect pedestrians, cars, signs)
  • Retail analytics (count products on shelves)
  • Security and surveillance (detect people, vehicles)
  • Medical imaging (locate tumors, lesions)
  • Wildlife monitoring (count and locate animals)
  • 3. Semantic Segmentation

What it does: Classifies every pixel in an image, creating a detailed map of the scene.

Question it answers: "What class does every pixel in this image belong to?"

Output: A pixel-by-pixel classification map where each pixel is assigned a category.

Use cases:

  • Autonomous driving (road, sidewalk, car, pedestrian, building — for every pixel)
  • Medical imaging (precise tumor boundaries)
  • Land use mapping (forest, water, urban, agricultural — from satellite images)
  • Augmented reality (separate foreground from background)
  • 4. OCR (Optical Character Recognition)

What it does: Extracts text from images , converting visual text into machine-readable text.

Question it answers: "What text is in this image?"

Output: Extracted text with position information.

Use cases:

  • Reading documents (contracts, forms, letters)
  • License plate recognition
  • Receipt and invoice digitization
  • Sign and label reading
  • Handwriting recognition
  • Business card scanning
  • 5. Facial Detection and Analysis

What it does: Detects human faces in images and optionally analyzes attributes.

Question it answers: "Are there faces in this image, and what can you tell about them?"

Output: Face locations and optional attributes.

  • Attribute Description
  • Face location Bounding box around each face
  • Age Estimated age (limited; needs Microsoft approval)
  • Head pose Rotation angles (pitch, roll, yaw)
  • Glasses Whether the person wears glasses
  • Facial landmarks Key points (eyes, nose, mouth, jaw)

Important: Microsoft has retired the Face API capabilities that infer emotion and gender, and limits age, smile, facial hair, hair and makeup to approved use cases, due to responsible AI concerns. The current Face API focuses on face detection, verification, and identification — not emotion or gender inference.

Comparison Table: Key Computer Vision Tasks

  • Task Input Output Question Answered
  • Image Classification Whole image Single label + confidence "What is this image?"
  • Object Detection Whole image Multiple objects + bounding boxes "Where are objects in this image?"
  • Semantic Segmentation Whole image Per-pixel classification map "What is every pixel in this image?"
  • OCR Image with text Extracted text + positions "What text is in this image?"
  • Facial Detection Image with faces Face locations + attributes "Where are faces and what do they look like?"

On the Exam: The most common question type is: "A company needs to [scenario]. Which computer vision task should they use?" Focus on the output: single label = classification, located objects = detection, pixel map = segmentation, extracted text = OCR, face analysis = facial detection.