Study guide

8.2 Nutanix Cluster Check (NCC) Architecture and Execution

Nutanix Certified Associate NCA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Nutanix Cloud Platform & HCI Foundations

1.1 Nutanix NCA Exam Overview, Format, and Objectives 1.2 Hyperconverged Infrastructure (HCI) vs. Traditional 3-Tier Architecture 1.3 The Nutanix Enterprise Cloud Portfolio (NCI, NUS, NCM, EUC, NC2)

2 Chapter 2: Platform Architecture & Distributed Core Services

2.1 Hardware Building Blocks: Nodes, Blocks, Clusters, and Quorum 2.2 Controller VM (CVM) Architecture, Datapath, and Autopathing 2.3 Core Distributed Services: Cassandra, Stargate, Curator, Zookeeper, and Genesis

3 Chapter 3: Prism Administration & Cluster Operations

3.1 Prism Element vs. Prism Central Architecture and Interface Navigation 3.2 Entity Management, Categories, and Role-Based Access Control 3.3 Nutanix Licensing Tiers, Add-ons, and Pulse Telemetry

4 Chapter 4: AOS Distributed Storage Fabric & Data Placement

4.1 Storage Pools, Storage Containers, and vDisk Virtual Architecture 4.2 Redundancy Factor (RF2 vs. RF3), Failure Domains, and Fault Tolerance 4.3 Data Locality Mechanics and Intelligent Lifecycle Management (ILM)

5 Chapter 5: Storage Optimization & Business Continuity

5.1 Storage Efficiency: Compression, Deduplication, and Erasure Coding (EC-X) 5.2 Space-Efficient Redirect-on-Write (ROW) Snapshots and Zero-Byte Clones 5.3 Protection Domains, Consistency Groups, and Disaster Recovery Replication

6 Chapter 6: AHV Virtual Machine Lifecycle Management

6.1 AHV VM Provisioning, Resource Allocation (vCPU, vRAM, Disks), and Boot Types 6.2 Nutanix Image Service and Virtual Machine Templates 6.3 Nutanix Guest Tools (NGT) Architecture, Features, and Deployment 6.4 AHV High Availability (HA), Acropolis Dynamic Scheduling (ADS), and Affinity Rules

7 Chapter 7: AHV Networking & Flow Security Fundamentals

7.1 AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges 7.2 Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes 7.3 Virtual Networks: Managed vs. Unmanaged Networks and IPAM 7.4 Nutanix Flow Network Security & Microsegmentation Fundamentals

8 Chapter 8: Cluster Maintenance, Health Monitoring & Support

8.1 Nutanix Cluster Health Monitoring, Alerts, and Events Engine 8.2 Nutanix Cluster Check (NCC) Architecture and Execution 8.3 Life Cycle Manager (LCM) and Rolling Non-Disruptive Upgrades 8.4 Nutanix Support Ecosystem: Diagnostics, Log Gathering, and Support Bundles

9 Chapter 9: Recognizing Nutanix Solutions, Hypervisors & the Product Portfolio

9.1 Supported Hypervisors for NCI and Feature Supportability 9.2 NCI Core Components, Configurations, and Common Deployment Scenarios 9.3 Nutanix Unified Storage: Files, Objects, and Volumes Use Cases 9.4 Nutanix Database Service (NDB) and Database Automation 9.5 Nutanix Kubernetes Platform, Enterprise AI, and End-User Computing

10 Chapter 10: Nutanix Tools — Migration, Deployment, and Validation

10.1 Nutanix Move: Cross-Hypervisor and Cloud Migration 10.2 Foundation and Foundation Central: Imaging and Cluster Deployment 10.3 X-Ray, Collector, and the Objective 1.3 Tool Inventory

11 Chapter 11: Cluster Configuration, Security & Hardware Maintenance

11.1 Cluster Services Configuration: DNS, NTP, SMTP, and SNMP 11.2 Cluster Security Options: Lockdown, Encryption, and the Recycle Bin 11.3 Node Maintenance Mode, Host Shutdown, and Cluster Shutdown 11.4 Cluster Expansion: Node Types and In-Node Expansion Capabilities 11.5 Out-of-Band Management and Remote Console Access

12 Chapter 12: Storage, Network, and Software Administration Tasks

12.1 Volume Groups, vDisk Placement, and Live vDisk Migration 12.2 Network Visualizer, Physical Switch Monitoring, and Network Segmentation 12.3 The Software Compatibility Matrix and Upgrade Path Planning 12.4 Taking and Managing VM Snapshots in Prism 12.5 License Operations: State, Assignment, Reclamation, and Expiry

13 Chapter 13: Performance Analysis, Reporting & Support Operations

13.1 Prism Analysis: Metric Charts, Entity Charts, and Custom Reports 13.2 Custom Alert Policies and Behavioural Anomaly Detection 13.3 Interpreting Workload Performance: CPU Contention, CPU Ready, Memory, and I/O Latency 13.4 Creating Support Cases, Required Documentation, and Insights

8.2 Nutanix Cluster Check (NCC) Architecture and Execution

Key Takeaways Explain This Topic AI

Nutanix Cluster Check (NCC) contains over 400 specialized diagnostic plugins distributed across hardware, hypervisor, storage, network, and cluster services.

NCC executes as a distributed Python framework initiated from any single Controller VM (CVM), leveraging SSH and internal RPCs to run checks across all cluster nodes concurrently.

NCC check outputs are categorized into four standardized states: PASS, INFO, WARN, and FAIL; every WARN or FAIL condition provides a direct Nutanix Knowledge Base (KB) article URL and identification number for root-cause resolution.

NCC release cycles are decoupled from AOS, allowing administrators to update the diagnostic suite independently via Life Cycle Manager (LCM) or standalone tarball without rebooting CVMs or disrupting VM workloads.

Last updated: September 2026

Nutanix Cluster Check (NCC) Architecture and Execution

Quick Summary: Nutanix Cluster Check (NCC) is a comprehensive diagnostic framework that audits hardware, storage, networking, hypervisor configurations, and distributed services across every node. Initiated via the CVM command line ( ncc health_checks run_all ) or the Prism Health dashboard, NCC produces standardized results (PASS, INFO, WARN, FAIL) directly linked to Nutanix Knowledge Base articles. Crucially, NCC releases are decoupled from AOS, allowing non-disruptive updates via Life Cycle Manager (LCM) or standalone tarball installers.

1. NCC Diagnostic Framework & Distributed Architecture

In complex hyperconverged environments, silent configuration drift, firmware incompatibilities, or asymmetric network configurations can introduce subtle operational risks. Nutanix Cluster Check (NCC) is the premier diagnostic suite engineered by Nutanix to uncover hardware anomalies, software misconfigurations, and performance bottlenecks before they escalate into production outages. +-------------------------------------------------------------------------+

  • | NCC Distributed Execution |
  • +-------------------------------------------------------------------------+
  • | [ Initiator: CVM 1 ] |
  • | Command: ncc health_checks run_all |
  • | - Coordinates check execution |
  • | - Splits plugins into parallel tasks |
  • +--------------------+-------------------+--------------------------------+
  • | |
  • (Internal RPC | & Passwordless | SSH)
  • v v
  • +-------------------+ +-------------------+
  • | Peer CVM 2 | | Peer CVM 3 |
  • | - Hardware Check | | - Hardware Check |
  • | - Storage Check | | - Storage Check |
  • +---------+---------+ +---------+---------+
  • | |
  • v v
  • +-------------------+ +-------------------+
  • | AHV/ESXi Host 2 | | AHV/ESXi Host 3 |
  • | - OVS MTU Check | | - OVS MTU Check |
  • +-------------------+ +-------------------+
  • | |
  • +----------+----------+
  • |
  • v
  • [ Aggregated Report ]
  • Status: PASS | INFO | WARN | FAIL
  • Output: Direct KB Article Links
  • Master-Worker Execution Model

NCC is built as a distributed, multi-node Python framework. When an administrator initiates NCC from any Controller VM (CVM):

Coordinator Role: The local CVM acts as the master coordinator. It queries the cluster database to enumerate all active nodes, hypervisors, and storage containers.

Parallel Task Dispatch: The coordinator splits the diagnostic suite into parallel test routines, dispatching execution instructions to worker daemons on all peer CVMs and underlying hypervisor hosts using passwordless intra-cluster SSH and internal remote procedure calls (RPCs).

Local Introspection: Each CVM inspects its own local daemons (querying Cassandra tables, Stargate sockets, and Zookeeper nodes), interrogates physical server hardware via IPMI/BMC interfaces, and queries hypervisor kernel modules.

Result Aggregation: Worker nodes return serialized check results to the coordinator CVM, which consolidates the findings into an interactive report displayed in the terminal or web GUI.

Non-Disruptive Execution: NCC operates entirely with read-only inspection primitives. It does not place locks on user data, restart system daemons, or interrupt storage I/O paths.

2. Command-Line Interface (CLI) Execution and Targeted Checks

While Prism provides an intuitive graphical interface, the CVM command-line interface provides systems engineers and automation scripts with fine-grained control over NCC execution.

Running All Checks

To execute the complete diagnostic suite across every node, container, and hypervisor in the cluster, log into any CVM via SSH as user nutanix and execute: ncc health_checks run_all

A full run executes over 400 specialized plugins and typically requires 10 to 20 minutes depending on cluster node count and disk capacity.

Executing Targeted Check Modules

When troubleshooting an isolated incident—such as resolving an upstream switch flap or checking disk replacement status—running the entire suite introduces unnecessary delay. Administrators can target specific functional modules:

Command Syntax Target Diagnostic Scope Primary Use Cases

ncc health_checks hardware_checks run_all Physical chassis, power supplies, cooling fans, DIMMs, disk controllers, drive slots. Post-hardware break-fix, diagnosing amber drive LEDs, thermal anomalies.

ncc health_checks network_checks run_all MTU consistency, inter-CVM latency, switch port negotiation, VLAN tagging, OVS bonds. Diagnosing packet loss, storage autopathing events, CVM link flapping.

ncc health_checks storage_checks run_all Storage pool capacity, container allocation, disk space, snapshot chains, ILM tiering. High disk utilization, snapshot growth triage, write performance latency.

ncc health_checks hypervisor_checks run_all Hypervisor versions, vSwitch bridges, host maintenance mode, kernel modules. Pre-hypervisor upgrade checks, live migration validation.

ncc health_checks system_checks run_all CVM memory/vCPU reservations, NTP synchronization, ZooKeeper quorum, DNS resolution. Cluster unresponsiveness, clock drift, cluster service initialization issues.

ncc health_checks data_protection_checks run_all Protection domains, Metro Availability witness, replication schedules, remote sites. DR drill validation, snapshot replication lag, witness heartbeat failures.

Targeting Specific Individual Plugins

To test a single parameter, administrators use the --plugin_list flag with the exact check plugin name: # Check CVM memory allocation against minimum sizing standards

ncc health_checks run_all --plugin_list=cvm_memory_usage_check

  • # Validate inter-CVM network latency
  • ncc health_checks run_all --plugin_list=cvm_latency_check
  • # Check NTP clock synchronization across all nodes
  • ncc health_checks run_all --plugin_list=ntp_server_check
  • Output Modifiers

--send_email=1 : Dispatches an HTML summary of the execution results to the email addresses configured in Prism Alert settings.

--log_file=<path> : Directs verbose diagnostic logging to a custom file path (default output is stored in /home/nutanix/data/logs/ncc-output-latest.log ).

3. Prism Element Health Dashboard GUI Execution

For administrators who prefer graphical operations, Prism Element embeds full NCC execution capabilities:

Log into Prism Element and navigate to Health .

In the right-hand action bar, click the Actions drop-down and select Run NCC Checks .

The Run Checks modal dialog appears, presenting two operational scopes:

All Checks: Executes the entire diagnostic catalog.

Specific Checks: Exposes checkboxes enabling the operator to select discrete categories (Hardware, Storage, Virtualization, Network, System).

Optionally enable Send email report to notify operational stakeholders upon completion.

  • Click Run . +-------------------------------------------------------------------------+
  • | Run NCC Checks [X] |
  • +-------------------------------------------------------------------------+
  • | Scope: |
  • | ( ) All Checks |
  • | (*) Specific Checks |
  • | |
  • | Categories: |
  • | [X] Hardware Checks [X] Network Checks |
  • | [ ] Storage Checks [ ] Virtualization Checks |
  • | [ ] System Checks [ ] Data Protection Checks |
  • | |
  • | Email Notification: |
  • | [X] Send email report to: ops-team@enterprise.local |
  • | |
  • | [ Cancel ] [ Run Checks ] |
  • +-------------------------------------------------------------------------+

Prism dispatches the request to the cluster master, registers an asynchronous task in the Tasks drawer, and visualizes real-time progress percentages. Once finished, a consolidated execution summary is appended to the Health page, and detailed reports can be exported as text or PDF documents.

4. Interpreting NCC Diagnostic Results and KB Resolution Workflow

Every check evaluated by NCC yields one of four standardized states. Understanding the operational severity of these states is vital for cluster administrators and exam candidates.

Execution State Definition & Operational Impact Administrative Action Required

PASS Monitored component, service, or metric is healthy and complies with all Nutanix best-practice baselines. No action required. Operational parameters are nominal.

INFO Highlights configuration nuances, non-critical settings, or informational environment telemetry. Review for architectural alignment. (Example: 1500-byte MTU detected when Jumbo Frames are not configured).

WARN Identifies component degradation, configuration drift, or approaching threshold that could impact resilience if unaddressed. Remediation recommended during standard operating hours. Follow referenced Knowledge Base article.

FAIL Identifies an active failure, service partition, broken requirement, or severe violation threatening cluster integrity. Immediate remediation required. Follow referenced Knowledge Base article or open Nutanix Support case.

The Knowledge Base (KB) Integration Pattern

A distinguished design feature of NCC is that it does not merely report that a test failed; it provides the exact diagnostic context and remediation recipe. Every WARN or FAIL output includes a direct URL and numerical identifier to a Nutanix Knowledge Base (KB) article.

Terminal Execution Output Example: Detailed information for cvm_memory_usage_check:

Node 10.10.10.11:

FAIL: CVM 10.10.10.11 memory usage is at 94% (exceeds threshold of 90%).

Refer to KB 2473 (http://portal.nutanix.com/kb/2473) for details on cvm_memory_usage_check or

remedy to resolve this failure.

When administrators observe this output, they access portal.nutanix.com , search for KB 2473 , and immediately obtain:

The underlying mathematical conditions that trigger the check.

Commands to isolate which CVM daemon is consuming excessive RAM.

Prescriptive steps to adjust CVM memory allocation or resolve memory leaks.

5. Independent NCC Release Cycle and Upgrade Methods

In traditional enterprise architectures, diagnostic tools are tied to monolithic operating system releases. If a vendor identifies a new bug signature or supports a new third-party drive model, customers must upgrade the entire operating system to obtain the updated diagnostic checks.

Nutanix decouples NCC from AOS. While every AOS release bundles the latest NCC build available at shipping time, the NCC release cycle operates on an independent, rapid cadence—often delivering updates every two to four weeks . +-------------------------------------------------------------------------+

  • | Monolithic Architecture vs. Decoupled NCC Architecture |
  • +-------------------------------------------------------------------------+
  • | Traditional: [ Monolithic OS (Kernel + Drivers + Diagnostics) ] |
  • | - Updating diagnostic rules requires full OS reboot and downtime |
  • | |
  • | Nutanix: [ Acropolis OS (AOS) Base Platform (Long-Term Stability) ] |
  • | [ Nutanix Cluster Check (NCC) Suite (Rapid Decoupled) ] |
  • | - Updated independently in 2 minutes via LCM or tarball |
  • | - Zero CVM reboots | Zero host maintenance | Zero VM impact |
  • +-------------------------------------------------------------------------+
  • Why Decoupling Matters

Proactive Detection: When Nutanix Worldwide Support discovers a rare bug signature in the field, engineering codifies that signature into a new NCC plugin. Customers can update NCC immediately, scanning their clusters to detect the defect before it impacts production.

New Hardware Validation: As hardware vendors release new SSD, NVMe, and NIC firmware revisions, NCC plugins are updated to validate compatibility without requiring an AOS upgrade.

Pre-Upgrade Qualification: Prior to executing major AOS or hypervisor upgrades, administrators upgrade NCC to the newest version to run pre-upgrade validation checks with the latest test logic.

Upgrade Delivery Methods

1-Click via Life Cycle Manager (LCM): In internet-connected environments, running an LCM inventory automatically discovers the latest NCC release. The administrator clicks Update , and LCM non-disruptively installs NCC across all nodes in under three minutes.

Prism Element Software Upgrade: Navigate to Settings > Upgrade Software > NCC . Prism downloads the package directly from the Nutanix Support Portal and applies it cluster-wide.

Dark Site Manual Installation (Air-Gapped): In secure environments lacking outbound internet connectivity, administrators download the standalone installer tarball ( nutanix-ncc-el7.x86_64-<version>.tar.gz ) from portal.nutanix.com , SCP the archive to /home/nutanix on any CVM, and execute: tar -xzf nutanix-ncc-el7.x86_64-<version>.tar.gz

./ncc/bin/install.sh The installer automatically distributes and updates the NCC binaries across all peer CVMs in the cluster. CVM services remain fully active, hypervisor hosts do not enter maintenance mode, and virtual machine execution is 100% unaffected.

Loading diagram... Nutanix Cluster Check (NCC) Distributed Architecture and Triage Workflow