Study guide

2.6 Azure Machine Learning Service

Microsoft Azure AI Fundamentals AI-900

Track your progress as you read

Finished sections get a check mark.

1 Introduction

About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900

2 Domain 1: Describe AI Workloads and Considerations (15-20%)

1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure

3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)

2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service

4 Domain 3: Computer Vision Workloads on Azure (15-20%)

3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence

5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)

4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service

6 Domain 5: Generative AI Workloads on Azure (15-20%)

5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications

7 Exam Review and Full-Length Practice Questions

6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI

2.6 Azure Machine Learning Service

Key Takeaways Explain This Topic AI

Azure Machine Learning is a cloud platform for training, deploying, and managing ML models — it provides tools for the entire ML lifecycle.

Automated ML (AutoML) automatically selects the best algorithm and hyperparameters for your data — no ML expertise required.

Azure ML Designer provides a drag-and-drop visual interface for building ML pipelines without writing code.

Azure ML supports model deployment as real-time endpoints (for immediate predictions) and batch endpoints (for processing large datasets).

The AI-900 tests your awareness of Azure ML capabilities, not your ability to use the platform or write code.

Last updated: June 2026

Quick Answer: Azure Machine Learning is a cloud platform for the entire ML lifecycle. Key features include Automated ML (AutoML) for automatic algorithm selection, Designer for visual drag-and-drop pipeline building, and model deployment as real-time or batch endpoints. Azure ML workspace is the central resource that organizes data, compute, models, and experiments.

What Is Azure Machine Learning?

Azure Machine Learning is Microsoft's cloud-based platform for building, training, deploying, and managing machine learning models. It provides tools for every stage of the ML lifecycle:

  • Lifecycle Stage Azure ML Feature Description
  • Data preparation Data assets, Datastores Connect to data sources, clean and transform data
  • Model training AutoML, Designer, Notebooks Train models using automated, visual, or code-based approaches
  • Model evaluation Metrics, Responsible AI dashboard Evaluate model performance and fairness
  • Model deployment Endpoints Deploy models as real-time or batch endpoints
  • Model monitoring Model monitoring Track model performance and detect drift in production
  • Azure ML Workspace

The Azure Machine Learning workspace is the top-level resource that organizes all ML assets:

  • Asset Description
  • Datastores Connections to data storage (Azure Blob, Data Lake, SQL)
  • Data assets Registered datasets used for training and evaluation
  • Compute Computing resources for training (clusters, instances)
  • Environments Software configurations (Python packages, Docker images)
  • Models Trained ML models registered for deployment
  • Endpoints Deployed model endpoints for serving predictions
  • Pipelines Automated workflows for data processing and model training
  • Experiments Collections of training runs with metrics and logs
  • Automated ML (AutoML)

Automated Machine Learning (AutoML) is one of the most important Azure ML features for the AI-900 exam. It automates the process of selecting the best ML algorithm and hyperparameters for your data.

  • What AutoML Does
  • Receives your dataset — you provide training data with features and labels

Tries multiple algorithms — linear regression, decision trees, random forests, gradient boosting, neural networks, etc.

  • Tunes hyperparameters — automatically adjusts settings for each algorithm
  • Evaluates performance — compares all models using appropriate metrics
  • Recommends the best model — presents the top-performing model with its metrics
  • AutoML Task Types
  • Task Type Output Example
  • Classification Category Predict spam/not spam
  • Regression Number Predict house price
  • Time-series forecasting Future numbers Predict next month's sales
  • Benefits of AutoML
  • No ML expertise needed — the system selects the algorithm for you
  • Fast experimentation — test dozens of algorithms in minutes
  • Transparent results — see which algorithms were tried and their performance
  • Reproducible — all experiments are logged and can be replicated

On the Exam: AutoML is a frequent topic. Know that it automatically selects the best algorithm and hyperparameters, requires no coding or ML expertise, and supports classification, regression, and time-series forecasting tasks.

Azure ML Designer

Azure ML Designer provides a drag-and-drop visual interface for building ML pipelines without writing code.

  • How Designer Works
  • Drag dataset onto the canvas
  • Add processing components — data transformations, feature selection
  • Add training component — select an algorithm
  • Connect components — create a visual pipeline flow
  • Run the pipeline — execute training on Azure compute
  • Evaluate results — view metrics and model performance
  • Designer vs. AutoML vs. Notebooks
  • Approach User Type Code Required Best For
  • AutoML Business users, beginners No Quick model building, no ML expertise
  • Designer Data analysts, visual learners No Custom pipelines with visual interface
  • Notebooks Data scientists, developers Yes (Python/R) Full control, custom algorithms, experimentation
  • Compute Resources

Azure ML provides different compute types for different needs:

  • Compute Type Purpose When to Use
  • Compute instance Development VM for notebooks Interactive development and testing
  • Compute cluster Scalable cluster for training Large-scale model training (scales to zero when idle)
  • Serverless compute On-demand training compute Quick training jobs without managing infrastructure
  • Kubernetes Inference cluster Real-time model serving in production
  • Model Deployment

After training, you deploy models as endpoints for applications to consume:

  • Real-Time Endpoints
  • Purpose: Immediate predictions (milliseconds response time)
  • Use case: A web app that predicts house prices when a user enters property details
  • How it works: Send a request with features, get a prediction back instantly
  • Batch Endpoints
  • Purpose: Process large datasets (minutes to hours)
  • Use case: Score 1 million customer records for churn prediction overnight
  • How it works: Submit a dataset, results are stored when processing completes

On the Exam: Know the difference between real-time (immediate predictions) and batch (large dataset processing) endpoints. A question asking "How should you serve predictions to a mobile app?" → real-time endpoint. "How should you score 500,000 records?" → batch endpoint.