Study guide

7.2 Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes

Nutanix Certified Associate NCA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Nutanix Cloud Platform & HCI Foundations

1.1 Nutanix NCA Exam Overview, Format, and Objectives 1.2 Hyperconverged Infrastructure (HCI) vs. Traditional 3-Tier Architecture 1.3 The Nutanix Enterprise Cloud Portfolio (NCI, NUS, NCM, EUC, NC2)

2 Chapter 2: Platform Architecture & Distributed Core Services

2.1 Hardware Building Blocks: Nodes, Blocks, Clusters, and Quorum 2.2 Controller VM (CVM) Architecture, Datapath, and Autopathing 2.3 Core Distributed Services: Cassandra, Stargate, Curator, Zookeeper, and Genesis

3 Chapter 3: Prism Administration & Cluster Operations

3.1 Prism Element vs. Prism Central Architecture and Interface Navigation 3.2 Entity Management, Categories, and Role-Based Access Control 3.3 Nutanix Licensing Tiers, Add-ons, and Pulse Telemetry

4 Chapter 4: AOS Distributed Storage Fabric & Data Placement

4.1 Storage Pools, Storage Containers, and vDisk Virtual Architecture 4.2 Redundancy Factor (RF2 vs. RF3), Failure Domains, and Fault Tolerance 4.3 Data Locality Mechanics and Intelligent Lifecycle Management (ILM)

5 Chapter 5: Storage Optimization & Business Continuity

5.1 Storage Efficiency: Compression, Deduplication, and Erasure Coding (EC-X) 5.2 Space-Efficient Redirect-on-Write (ROW) Snapshots and Zero-Byte Clones 5.3 Protection Domains, Consistency Groups, and Disaster Recovery Replication

6 Chapter 6: AHV Virtual Machine Lifecycle Management

6.1 AHV VM Provisioning, Resource Allocation (vCPU, vRAM, Disks), and Boot Types 6.2 Nutanix Image Service and Virtual Machine Templates 6.3 Nutanix Guest Tools (NGT) Architecture, Features, and Deployment 6.4 AHV High Availability (HA), Acropolis Dynamic Scheduling (ADS), and Affinity Rules

7 Chapter 7: AHV Networking & Flow Security Fundamentals

7.1 AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges 7.2 Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes 7.3 Virtual Networks: Managed vs. Unmanaged Networks and IPAM 7.4 Nutanix Flow Network Security & Microsegmentation Fundamentals

8 Chapter 8: Cluster Maintenance, Health Monitoring & Support

8.1 Nutanix Cluster Health Monitoring, Alerts, and Events Engine 8.2 Nutanix Cluster Check (NCC) Architecture and Execution 8.3 Life Cycle Manager (LCM) and Rolling Non-Disruptive Upgrades 8.4 Nutanix Support Ecosystem: Diagnostics, Log Gathering, and Support Bundles

9 Chapter 9: Recognizing Nutanix Solutions, Hypervisors & the Product Portfolio

9.1 Supported Hypervisors for NCI and Feature Supportability 9.2 NCI Core Components, Configurations, and Common Deployment Scenarios 9.3 Nutanix Unified Storage: Files, Objects, and Volumes Use Cases 9.4 Nutanix Database Service (NDB) and Database Automation 9.5 Nutanix Kubernetes Platform, Enterprise AI, and End-User Computing

10 Chapter 10: Nutanix Tools — Migration, Deployment, and Validation

10.1 Nutanix Move: Cross-Hypervisor and Cloud Migration 10.2 Foundation and Foundation Central: Imaging and Cluster Deployment 10.3 X-Ray, Collector, and the Objective 1.3 Tool Inventory

11 Chapter 11: Cluster Configuration, Security & Hardware Maintenance

11.1 Cluster Services Configuration: DNS, NTP, SMTP, and SNMP 11.2 Cluster Security Options: Lockdown, Encryption, and the Recycle Bin 11.3 Node Maintenance Mode, Host Shutdown, and Cluster Shutdown 11.4 Cluster Expansion: Node Types and In-Node Expansion Capabilities 11.5 Out-of-Band Management and Remote Console Access

12 Chapter 12: Storage, Network, and Software Administration Tasks

12.1 Volume Groups, vDisk Placement, and Live vDisk Migration 12.2 Network Visualizer, Physical Switch Monitoring, and Network Segmentation 12.3 The Software Compatibility Matrix and Upgrade Path Planning 12.4 Taking and Managing VM Snapshots in Prism 12.5 License Operations: State, Assignment, Reclamation, and Expiry

13 Chapter 13: Performance Analysis, Reporting & Support Operations

13.1 Prism Analysis: Metric Charts, Entity Charts, and Custom Reports 13.2 Custom Alert Policies and Behavioural Anomaly Detection 13.3 Interpreting Workload Performance: CPU Contention, CPU Ready, Memory, and I/O Latency 13.4 Creating Support Cases, Required Documentation, and Insights

7.2 Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes

Key Takeaways Explain This Topic AI

Physical uplinks on an AHV host should always use homogeneous speeds (e.g., dual 10GbE or dual 25GbE); mixing 1GbE and 10GbE interfaces within the same bridge bond causes asymmetric throughput bottlenecks and severe failover penalties.

The default bonding mode in AHV is active-backup, which routes all traffic through a single active physical adapter, requires zero upstream switch configuration, and executes sub-second failover to standby uplinks upon link loss.

The balance-slb mode balances outbound traffic based on guest VM vNIC source MAC addresses without requiring upstream switch LACP configuration, though a single VM stream cannot exceed the throughput of a single physical uplink.

The balance-tcp mode leverages dynamic IEEE 802.3ad Link Aggregation Control Protocol (LACP) and hashes Layer 2 through Layer 4 headers (IPs, ports, protocol), enabling multiple concurrent TCP flows from a single VM or CVM to utilize aggregate bond bandwidth.

Nutanix strongly recommends configuring LACP with a fast transmission rate (1-second heartbeat intervals) and enabling lacp-fallback to prevent host isolation if upstream switches fail to negotiate link aggregation.

Last updated: September 2026

Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes

Quick Summary: In a Nutanix enterprise cloud, physical network adapters (NICs) on each AHV host are aggregated into logical bonds attached to virtual switches. The architectural selection of physical adapters, switch configurations, and bonding modes directly dictates cluster throughput, failover behavior, and operational resilience. AHV provides three distinct bonding modes: active-backup (the default, zero-configuration mode providing instant failover), balance-slb (source-MAC load balancing across multiple active uplinks without upstream switch complexity), and balance-tcp (enterprise LACP link aggregation with Layer 2–4 per-flow distribution). Managing these configurations is streamlined through the Prism Virtual Switch UI and the host-level manage_ovs CLI utility.

1. Physical NIC Selection and Hardware Topology

Enterprise hyperconverged infrastructure demands reliable, high-bandwidth interconnects because physical network uplinks carry both traditional client-to-VM traffic and east-west Distributed Storage Fabric (DSF) storage replication data.

Network Adapter Speed and Homogeneity

Nutanix nodes typically ship with dual-port or quad-port Network Interface Cards supporting 10GbE (SFP+) , 25GbE (SFP28) , 40GbE (QSFP+) , or 100GbE (QSFP28) interfaces. +-------------------------------------------------------------------------+

  • | Uplink Speed Homogeneity |
  • +------------------------------------+------------------------------------+
  • | RECOMMENDED: Homogeneous Pair | PROHIBITED: Asymmetric Mixing |
  • | | |
  • | +------------+ +------------+ | +------------+ +------------+ |
  • | | eth2:10GbE | | eth3:10GbE | | | eth0: 1GbE | | eth2:10GbE | |
  • | +------------+ +------------+ | +------------+ +------------+ |
  • | \ / | \ / |
  • | v v | v v |
  • | [ Bond: br0-up (20G) ] | [ Bond: br0-up (Unstable) ] |
  • | Predictable latency & failover | Severe throughput choke-point |
  • +------------------------------------+------------------------------------+

[!CRITICAL] Never mix 1GbE and 10GbE+ interfaces in the same bond or bridge. While standard Linux bonding technically permits grouping adapters of disparate speeds, doing so in an AHV storage cluster introduces severe hazards. If an active-backup bond fails over from a 10GbE adapter to a 1GbE adapter, the sudden 90% reduction in bandwidth chokes storage write replication, triggering I/O latency spikes and cluster health degradation. 1GbE interfaces (typically onboard motherboard ports) should either be left disconnected or assigned to a dedicated out-of-band management bridge ( br1 ), leaving high-speed 10GbE/25GbE adapters for br0 .

Redundant Top-of-Rack (ToR) Cabling Architecture

To eliminate single points of physical failure:

Each AHV node must connect its bonded uplinks across two separate physical Top-of-Rack (ToR) switches (e.g., Switch A and Switch B).

For active-backup and balance-slb , the physical switches do not need to be clustered or stacked; standard independent Layer 2/3 switches operate seamlessly.

For balance-tcp , the two physical switches must support a multi-chassis link aggregation technology—such as Cisco Virtual PortChannel (vPC), Arista Multi-Chassis Link Aggregation (MLAG), or Dell Virtual Link Trunking (VLT)—so that the host views the physical uplinks as terminating on a single logical switch.

2. AHV NIC Bonding Modes: Technical Deep Dive

In AHV, physical network interfaces attached to a virtual bridge are pooled into a single bonded interface port named br0-up (or vs0-up ). AHV natively supports three bonding modes, each balancing configuration complexity against traffic distribution efficiency. +---------------------------------------------------------------------------------+

  • | AHV NIC Bonding Modes |
  • +---------------------+-------------------------+---------------------------------+
  • | Mode | Upstream Switch Config | Traffic Distribution Algorithm |
  • +---------------------+-------------------------+---------------------------------+
  • | active-backup | None (Any switch) | 1 Active Uplink; Standby on fail|
  • | balance-slb | None (Any switch) | Source-MAC hash across uplinks |
  • | balance-tcp (LACP) | Dynamic LACP (MLAG/vPC) | L2-L4 5-tuple hash per flow |
  • +---------------------+-------------------------+---------------------------------+
  • Mode 1: active-backup (Default Out-of-the-Box Mode)

active-backup is the default bonding mode configured during cluster foundation. It is engineered for maximum operational simplicity and universal hardware compatibility.

Operational Mechanics: Exactly one physical adapter in the bond is elected as the active interface; all other adapters remain in standby. All network traffic generated by the Controller VM ( eth0 ), the AHV host ( br0 ), and all running guest VMs traverses this single active adapter.

Upstream Switch Requirements: Zero configuration. Upstream physical switch ports are configured as standard independent trunk ports carrying the required VLANs. No port channels, LACP, or switch stacking are required.

Failover Characteristics: If the active physical adapter detects a carrier loss (cable pull, transceiver failure, or switch port shutdown), AHV initiates failover in under 100 milliseconds . OVS immediately transitions an inactive standby adapter to active and broadcasts gratuitous ARP (GARP) updates to notify upstream switches of the MAC address relocation.

Failback Behavior: When the failed primary link restores, AHV by default continues operating on the currently active adapter to avoid unnecessary link flapping, unless explicit failback policies are enforced.

Mode 2: balance-slb (Source-Load Balancing)

balance-slb enhances uplink utilization by distributing traffic across all active physical adapters without introducing complex switch configurations.

Operational Mechanics: OVS assigns each virtual machine's virtual network interface (and CVM interfaces) to an active physical uplink based on the virtual machine's source MAC address . If Host Node 1 has two 10GbE uplinks ( eth2 , eth3 ) and runs four VMs:

VM 1 and VM 2 (hashed to eth2 ) transmit via eth2 .

VM 3, VM 4, and CVM (hashed to eth3 ) transmit via eth3 .

Upstream Switch Requirements: Zero configuration. Because each specific virtual MAC address is strictly pinned to a single physical port at any given instant, upstream switches never observe the same MAC address appearing across multiple ports simultaneously. This avoids MAC flapping and switch port security violations without requiring physical switch clustering.

Dynamic Load Rebalancing: OVS periodically evaluates the traffic load across bonded physical interfaces (default rebalance timer is 10 seconds ). If the bandwidth utilization between two physical adapters differs by more than 25% , OVS dynamically re-hashes one or more virtual machine MAC addresses to the less utilized uplink.

Performance Ceiling: A single virtual machine (or single virtual NIC) cannot transmit faster than the line rate of a single physical adapter. A VM on a dual-10GbE balance-slb bond has a maximum throughput ceiling of 10 Gbps.

Caution

balance-slb is not compatible with upstream switch Link Aggregation Control Protocol (LACP) configurations. Furthermore, environments utilizing IGMP snooping or complex multicast topologies should avoid balance-slb due to potential multicast packet duplication or drops during dynamic rebalancing.

Mode 3: balance-tcp (LACP / IEEE 802.3ad Link Aggregation)

balance-tcp is the premier enterprise bonding mode for environments requiring true multi-flow load distribution and maximum bandwidth utilization.

Operational Mechanics: balance-tcp utilizes the standard IEEE 802.3ad Link Aggregation Control Protocol (LACP) . Rather than hashing based solely on source MAC addresses, OVS parses the packet headers and calculates a 5-tuple hash : Hash = f ( Source IP , Destination IP , Source Port , Destination Port , Protocol ) \text{Hash} = f(\text{Source IP}, \text{Destination IP}, \text{Source Port}, \text{Destination Port}, \text{Protocol}) Hash = f ( Source IP , Destination IP , Source Port , Destination Port , Protocol )

Multi-Flow Acceleration: Because hash calculations occur per TCP/UDP flow rather than per VM MAC, a single virtual machine with multiple concurrent network connections can utilize multiple physical uplinks simultaneously .

A high-transaction Microsoft SQL Server establishing dozens of database sessions can transmit across both eth2 and eth3 concurrently, achieving aggregate throughput approaching 20 Gbps on a dual-10GbE bond.

The Controller VM (CVM) distributing storage replication extents across multiple remote nodes utilizes all bonded uplinks simultaneously, significantly accelerating cluster write performance.

Upstream Switch Requirements: Upstream physical switches MUST be explicitly configured for dynamic LACP. In multi-switch topologies, switches must run a cross-chassis protocol (Cisco vPC, Arista MLAG, Juniper MC-LAG).

LACP Timers (Fast vs. Slow):

Slow Rate (30-second heartbeat): LACP Control Protocol Data Units (LPDUs) exchange every 30 seconds; link failure detection can take up to 90 seconds.

Fast Rate (1-second heartbeat - Recommended): LPDUs exchange every 1 second; link failure is detected within 3 seconds , ensuring rapid convergence.

lacp-fallback Protection: If an AHV host boots while upstream physical switches are undergoing maintenance or unconfigured for LACP, standard LACP bonds drop all traffic. AHV implements lacp-fallback , which automatically falls back to standard active-backup operation if LACP negotiations fail, preventing host isolation.

  • Feature active-backup balance-slb balance-tcp
  • Default Mode Yes (Out-of-the-box) No No
  • Upstream Switch Setup None required None required LACP / 802.3ad & MLAG Required

Uplink Utilization 1 Active, others Standby All Active (Per-VM MAC distribution) All Active (Per-Flow 5-tuple distribution)

  • Single VM Bandwidth 1 Uplink Speed (e.g., 10G) 1 Uplink Speed (e.g., 10G) Multi-Uplink Aggregate (e.g., 20G+)
  • CVM DSF Replication Single active adapter Distributed by MAC Distributed across all flows
  • LACP Fallback N/A N/A Supported (Reverts to active-backup)

Best For Maximum simplicity & compatibility Multi-VM balancing without switch config High-throughput enterprise & database clusters

3. Configuring Virtual Switches via Prism UI

Introduced in AOS 5.11 and expanded in modern AOS releases, the Prism Virtual Switch management engine abstracts underlying OVS complexity into an intuitive graphical interface within Prism Element and Prism Central. +-------------------------------------------------------------------------+

  • | Prism Virtual Switch Architecture |
  • | |
  • | Virtual Switch: vs0 (Default Virtual Switch) |
  • | ├── Underlying OVS Bridge: br0 |
  • | ├── MTU Configuration: 1500 (Standard) or 9000 (Jumbo Frames) |
  • | ├── Bond Configuration: vs0-up (Interfaces: eth2, eth3) |
  • | └── Bonding Mode: Active-Backup | Balance-SLB | Balance-TCP |
  • +-------------------------------------------------------------------------+
  • Prism Virtual Switch Workflows

Navigating to Network Configuration: In Prism Element, navigate to Settings (Gear Icon) -> Network Configuration -> Virtual Switch .

Editing the Default Virtual Switch ( vs0 ):

By default, all AHV nodes belong to vs0 (mapped to br0 ).

Administrators can review member nodes, assigned physical uplinks, and current bond modes.

Switching Bond Modes:

To change from active-backup to balance-tcp , select vs0 , click Edit , choose Connected with LACP (balance-tcp) , and set the LACP rate to Fast .

Prism automatically orchestrates rolling updates across all hosts in the cluster, validating link state before applying changes to prevent cluster-wide disconnects.

Jumbo Frames (MTU 9000):

Sizing MTU to 9000 reduces CPU packet header processing overhead for high-throughput storage networks.

MTU must be enabled end-to-end : on the Prism Virtual Switch, on the physical ToR switch ports, and on any intervening routers. A mismatched MTU causes packet fragmentation and severe I/O timeouts.

4. Host CLI Administration: manage_ovs and ovs-vsctl

While the Prism UI handles standard operations, system administrators require CLI tools for deployment automation, troubleshooting, and advanced diagnostics.

The Nutanix manage_ovs Command-Line Tool

manage_ovs is the official, Nutanix-supported cluster-aware Python utility for inspecting and configuring network uplinks and bridges on AHV nodes. # Inspect all physical network adapters and current uplink bond states

manage_ovs show_uplinks

  • # Detailed interface status and link carrier state (speed, duplex, link)
  • manage_ovs show_interfaces
  • # Configure a 10GbE uplink bond in active-backup mode
  • manage_ovs --bridge_name br0 --interfaces eth2,eth3 --bond_mode active-backup update_uplinks
  • # Configure uplinks with balance-tcp (LACP) and fast transmission rate
  • manage_ovs --bridge_name br0 --interfaces eth2,eth3 --bond_mode balance-tcp --lacp_mode fast update_uplinks
  • Cluster-Wide Execution via allssh

To query or modify network configurations across all nodes in the cluster simultaneously, administrators execute manage_ovs from any Controller VM using the allssh wrapper: # Check uplink status across every AHV node in the entire cluster

  • allssh "ssh root@192.168.5.1 manage_ovs show_uplinks"
  • Low-Level Diagnostics with ovs-vsctl

ovs-vsctl is the raw Open vSwitch management command. It directly queries the local ovsdb-server database: # Display full OVS bridge, port, interface, and bond hierarchy

ovs-vsctl show

  • # Inspect specific port bonding options and LACP status
  • ovs-vsctl list port br0-up
  • # Inspect LACP partner negotiation status on physical links
  • ovs-appctl bond/show br0-up
  • ovs-appctl lacp/show br0-up

Important

Always use manage_ovs or the Prism UI for configuration changes. Manual changes executed via ovs-vsctl may be overwritten during AHV upgrades or Acropolis cluster synchronization tasks.

Loading diagram... AHV Bonding Modes Traffic Distribution and Physical Switch Dependencies