Study guide

3.3 Azure AI Custom Vision and Face Services

Microsoft Azure AI Fundamentals AI-900

Track your progress as you read

Finished sections get a check mark.

1 Introduction

About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900

2 Domain 1: Describe AI Workloads and Considerations (15-20%)

1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure

3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)

2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service

4 Domain 3: Computer Vision Workloads on Azure (15-20%)

3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence

5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)

4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service

6 Domain 5: Generative AI Workloads on Azure (15-20%)

5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications

7 Exam Review and Full-Length Practice Questions

6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI

3.3 Azure AI Custom Vision and Face Services

Key Takeaways Explain This Topic AI

Azure AI Custom Vision lets you train custom image classification and object detection models using your own labeled images — as few as 5-10 images per category.

Custom Vision provides a portal for uploading images, adding labels/tags, training the model, and testing predictions — all without writing code.

Azure AI Face detects human faces in images, supporting face verification (is this the same person?) and face identification (who is this person?).

Face verification compares two faces to determine if they belong to the same person (1:1 matching); face identification matches a face against a group of known people (1:many matching).

Microsoft restricts access to facial recognition capabilities — identification and verification features require an approved application due to responsible AI concerns.

Last updated: October 2026

Quick Answer: Custom Vision trains custom image classification and object detection models from your own labeled images. Face API detects faces and supports verification (is this the same person?) and identification (who is this person?). Microsoft restricts facial recognition features due to responsible AI concerns.

Azure AI Custom Vision

Azure AI Custom Vision lets you train your own image classification and object detection models without machine learning expertise. You provide labeled images, and the service handles model training.

Custom Vision vs. Azure AI Vision

  • Feature Azure AI Vision Custom Vision
  • Model Pre-built, general-purpose Custom, trained on your data
  • Training required No Yes (upload and label images)
  • Categories General (thousands of built-in) Custom (your own categories)
  • Use case General image analysis Domain-specific classification
  • Example "This is a dog" "This is a Labrador with hip dysplasia"
  • When to Use Custom Vision

Use Custom Vision when the pre-built Azure AI Vision model does not recognize the specific categories you need:

  • Manufacturing: Identify specific product defects (scratch, dent, discoloration)
  • Agriculture: Classify crop diseases (blight, rust, mildew)
  • Retail: Identify your specific product brands and variants
  • Healthcare: Classify medical images by condition (requires domain expertise)
  • Wildlife: Identify specific species in camera trap images
  • Training a Custom Vision Model
  • Step 1: Create a Custom Vision resource
  • Create the resource in the Azure portal
  • Choose between training and prediction resources
  • Step 2: Create a project
  • Select the project type: Image Classification or Object Detection
  • For classification, choose: Multilabel (multiple tags per image) or Multiclass (one tag per image)
  • Step 3: Upload and tag images
  • Upload training images for each category
  • Add tags (labels) to each image
  • Minimum: 5 images per tag (recommended: 50+ for better results)
  • Step 4: Train the model
  • Click "Train" to start the training process
  • Choose Quick Training (fast, less accurate) or Advanced Training (slower, more accurate)
  • Step 5: Evaluate and test
  • Review precision, recall, and AP (Average Precision) metrics
  • Test with new images to verify predictions
  • Step 6: Publish and use
  • Publish the trained model as a prediction endpoint
  • Call the endpoint from your application to classify new images
  • Custom Vision Project Types
  • Project Type Task Output
  • Image Classification (Multiclass) Assign ONE tag per image "This is a Labrador"
  • Image Classification (Multilabel) Assign MULTIPLE tags per image "outdoor", "sunny", "park"
  • Object Detection Locate objects with bounding boxes "Labrador at position (x, y, w, h)"
  • Azure AI Face Service

Azure AI Face is a service for detecting, recognizing, and analyzing human faces in images.

Face Detection

Detects human faces in an image and returns:

  • Face location — bounding box coordinates
  • Face landmarks — key points (eyes, nose, mouth, jaw)
  • Head pose — rotation angles
  • Face mask — whether the person is wearing a face mask
  • Blur and noise — quality assessment of the face image
  • Face Verification (1:1)

Compares two face images to determine if they belong to the same person.

  • Input Output Use Case
  • Photo A + Photo B Same person: Yes/No + confidence Identity verification for secure login

Example: A banking app compares a selfie taken during login with the photo on file to verify the user's identity.

Face Identification (1:Many)

Matches one face against a group of known faces to identify who it is.

  • Input Output Use Case
  • Photo + Person Group Identified person + confidence Employee access control

Example: An office building uses facial identification to grant access — the system compares a person's face against all registered employees.

Responsible AI Restrictions on Face API

Microsoft has implemented significant restrictions on the Face API due to responsible AI concerns:

  • Feature Status Reason
  • Face detection Available (general access) Low risk — detects faces without identification
  • Face verification Restricted (requires approval) Medium risk — used for identity verification
  • Face identification Restricted (requires approval) High risk — used for surveillance and tracking
  • Emotion detection Retired Unreliable — facial expressions don't reliably indicate emotions
  • Gender inference Retired Biased — inaccurate and potentially harmful
  • Age, smile, facial hair, hair, makeup Limited (approval required) Misuse risk

On the Exam: Know that Microsoft has RETIRED emotion detection and gender inference from the Face API (age is limited). Face detection is generally available, but verification and identification require an approved application. This is a direct application of responsible AI principles.

Face Liveness Detection

A newer capability that determines whether a face in the camera is a real, live person or a spoofing attempt (photo, video, or mask). This prevents attacks where someone holds up a photo to bypass facial verification.

  • Detection Method What It Catches
  • Passive liveness Photos held to camera, video replays
  • Active liveness Requires user to perform an action (blink, turn head)

On the Exam: Face liveness detection is an important security feature. Know that it prevents spoofing attacks where someone uses a photo or video instead of their real face. This is relevant to both the reliability/safety and privacy/security responsible AI principles.