Study guide
2.2 Regression Models
Microsoft Azure AI Fundamentals AI-900
Track your progress as you read
Finished sections get a check mark.
1 Introduction
About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900
2 Domain 1: Describe AI Workloads and Considerations (15-20%)
1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure
3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)
2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service
4 Domain 3: Computer Vision Workloads on Azure (15-20%)
3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence
5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)
4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service
6 Domain 5: Generative AI Workloads on Azure (15-20%)
5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications
7 Exam Review and Full-Length Practice Questions
6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI
2.2 Regression Models
Key Takeaways Explain This Topic AI
Regression models predict continuous numerical values — house prices, temperatures, sales volumes, stock prices.
Linear regression finds the straight-line relationship between features and the label; it is the simplest regression algorithm.
Key evaluation metrics for regression: MAE (average error magnitude), RMSE (penalizes large errors), R-squared (proportion of variance explained, where 1.0 = perfect).
R-squared (coefficient of determination) ranges from 0 to 1 — higher values indicate better model fit. An R-squared of 0.85 means the model explains 85% of variance in the data.
The AI-900 tests conceptual understanding of regression — you will not be asked to calculate metrics or write regression code.
Last updated: June 2026
Quick Answer: Regression models predict continuous numerical values like prices, temperatures, and quantities. Linear regression finds the straight-line relationship between features and the label. Key evaluation metrics are MAE (Mean Absolute Error), RMSE (Root Mean Squared Error), and R-squared (proportion of variance explained). Higher R-squared values indicate better model performance.
What Is Regression?
Regression is a supervised machine learning technique that predicts a continuous numerical value based on input features. The output is a number on a continuous scale, not a category.
How to Identify a Regression Problem
Ask yourself: Is the predicted output a number on a continuous scale?
- Predicting a house price ($450,000) → Regression (continuous number)
- Predicting if an email is spam → Classification (category)
- Predicting tomorrow's temperature (72.5°F) → Regression (continuous number)
- Predicting customer segment → Clustering (group)
- Linear Regression
Linear regression is the simplest and most fundamental regression algorithm. It finds the straight-line relationship between features and the label.
Simple Linear Regression (One Feature)
With one feature, linear regression fits a straight line through the data:
- Formula: y = mx + b
- y = predicted value (label)
- x = input value (feature)
- m = slope (how much y changes when x changes by 1)
- b = y-intercept (value of y when x = 0)
- Example: Predicting house price (y) based on square footage (x)
- If m = 200 and b = 50,000
- A 1,500 sq ft house: y = 200(1,500) + 50,000 = $350,000
- Multiple Linear Regression (Multiple Features)
With multiple features, the model accounts for several input variables:
- Formula: y = m₁x₁ + m₂x₂ + m₃x₃ + ... + b
- Example: Predicting house price based on square footage (x₁), bedrooms (x₂), and age (x₃)
- Regression Evaluation Metrics
After training a regression model, you evaluate its performance using these metrics:
Mean Absolute Error (MAE)
The average absolute difference between predicted and actual values.
Interpretation: On average, how far off are the predictions?
- Example: MAE of $15,000 means predictions are off by $15,000 on average
- Lower is better
- Root Mean Squared Error (RMSE)
The square root of the average squared differences between predicted and actual values.
- Interpretation: Similar to MAE but penalizes larger errors more heavily
- Example: RMSE of $20,000 (larger than MAE because big errors are penalized more)
- Lower is better
- R-squared (Coefficient of Determination)
The proportion of variance in the label that the model explains.
Range: 0 to 1 (can be negative for very poor models)
Interpretation: How much of the variation in the output does the model explain?
- Example: R² = 0.85 means the model explains 85% of the variation in house prices
- Higher is better (1.0 = perfect, 0 = no better than predicting the average)
- Metric What It Measures Good Values Direction
- MAE Average prediction error Close to 0 Lower is better
- RMSE Average error (penalizes large errors) Close to 0 Lower is better
- R-squared Proportion of variance explained Close to 1.0 Higher is better
On the Exam: You will NOT be asked to calculate these metrics. You need to know what each metric means, how to interpret it, and which direction is "better." Common question: "An R-squared of 0.92 indicates that..." → the model explains 92% of the variance in the data.
Common Regression Use Cases
- Use Case Features Label
- House price prediction Size, bedrooms, location Price ($)
- Sales forecasting Month, promotions, weather Sales volume
- Temperature prediction Date, location, humidity Temperature (°F)
- Stock price prediction Volume, market index, news Stock price ($)
- Delivery time estimation Distance, traffic, weather Delivery time (minutes)
- Insurance premium pricing Age, health history, coverage Premium ($/month)
- Energy consumption Time, weather, building size Energy (kWh)
- Regression vs. Classification: The Key Difference
- Aspect Regression Classification
- Output type Continuous number Discrete category
- Examples $450,000, 72.5°F, 3.7 hours Spam/Not Spam, Cat/Dog, Yes/No
- Question answered "How much?" or "How many?" "Which category?" or "Is it X?"
- Evaluation MAE, RMSE, R-squared Accuracy, Precision, Recall, F1