Study guide
3.4 Endpoint Deployment, Onboarding & Troubleshooting
Cisco 350-801 CLCOR CCNP/CCIE Collaboration Core v2.0
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Collaboration Architecture, Deployment Models, Sizing & Upgrades
1.1 Collaboration Architecture & Deployment Models 1.2 Capacity Planning, Sizing & Bandwidth Considerations 1.3 High Availability, Redundancy & Disaster Recovery 1.4 Cisco Unified CM Cluster Upgrade Process
2 Chapter 2: Edge Architecture, Security & Network Services
2.1 Collaboration Edge Architecture: CUBE & Expressway 2.2 Security Protocols & PKI: SSO, OAuth, TLS & SRTP 2.3 Network Infrastructure Services: DNS, NTP, DHCP & LDAP
3 Chapter 3: Protocols, Codecs & Endpoint Provisioning
3.1 SIP Signaling Architecture & Call Flows 3.2 Session Description Protocol (SDP) & Early Offer vs. Delayed Offer 3.3 Audio/Video Codecs & DTMF Relay 3.4 Endpoint Deployment, Onboarding & Troubleshooting
4 Chapter 4: CUCM Dial Plan Fundamentals & Digit Analysis
4.1 Partitions and Calling Search Spaces (CSS) 4.2 Route Patterns, Route Groups & Route Lists 4.3 Translation Patterns, Transformation Patterns & Digit Manipulation 4.4 Globalized Call Routing & Local Route Group (LRG)
5 Chapter 5: Advanced Call Control, Call Routing & User Management
5.1 Call Admission Control (CAC), Locations & AAR 5.2 Toll Fraud Prevention & Call Privileges 5.3 CUCM User Management, LDAP Integration & RBAC 5.4 Administrative XML (AXL) API & Dial-Plan Troubleshooting Tools
6 Chapter 6: Cisco Unity Connection & Voicemail Integration
6.1 Cisco Unity Connection Architecture & SIP Integration 6.2 Mailbox Provisioning, User Templates & Class of Service 6.3 Message Waiting Indication (MWI) & Troubleshooting 6.4 Call Handlers & Directory Handlers
7 Chapter 7: IOS XE Voice Gateways, CUBE & Media Resources
7.1 Cisco IOS XE Voice Gateways & Dial Peers 7.2 Voice Translation Rules and Translation Profiles 7.3 Cisco Unified Border Element (CUBE) Configuration & Redundancy 7.4 IOS XE Media Resources & DSP Management
8 Chapter 8: Webex Architecture, Control Hub, Meetings & Messaging
8.1 Webex Suite Overview & Control Hub Architecture 8.2 Cloud Identity Management, SCIM & Directory Connector 8.3 Webex Developer Platform & APIs 8.4 Configuring Webex Cloud Meetings 8.5 Configuring Webex Cloud Messaging
9 Chapter 9: Webex Calling Routing, Permissions & PSTN Connectivity
9.1 Webex Calling Architecture, Locations & Number Management 9.2 Webex Calling Routing, Trunks & Dial Plans 9.3 Webex Calling Call Routing Process & Translation Patterns 9.4 Webex Calling Toll Fraud Prevention, Call Permissions & Operating Modes 9.5 PSTN Connectivity: Cloud-Connected PSTN (CC-PSTN) & Cisco Calling Plans 9.6 Webex Calling Local Gateway (LGW) Architecture & Configuration
10 Chapter 10: Webex Hybrid Services & Cloud Connected UC
10.1 Cloud-Connected UC (CCUC) Architecture & Telemetry 10.2 Webex Hybrid Calendar & Hybrid Directory Services 10.3 Webex Video Mesh & Hybrid Data Security
11 Chapter 11: Media Quality, QoS Engineering & Troubleshooting
11.1 Real-Time Media Characteristics & Impairments 11.2 QoS Classification, Marking & Trust Boundaries 11.3 Low Latency Queuing (LLQ) Configuration on Cisco IOS XE 11.4 Troubleshooting Media Quality & Call Failures
3.4 Endpoint Deployment, Onboarding & Troubleshooting
Key Takeaways Explain This Topic AI
The Cisco IP Phone boot sequence encompasses 8 deterministic stages: PoE power, voice VLAN discovery via CDP/LLDP-MED, DHCP lease with Option 150 TFTP IP, CTL/ITL security trust initialization, XML configuration file download, firmware verification, SIP registration, and keepalive establishment.
DHCP Option 150 delivers a list of redundant TFTP server IPv4 addresses, distinguishing it from standard DHCP Option 66 which specifies only a single TFTP IP or FQDN.
'Trust List Update Failed' errors stem from an ITL or CTL cryptographic signature mismatch following cluster certificate regenerations or migrations, requiring manual ITL clearance or hardware factory resets.
Endpoints can be provisioned manually, through IVR-based Self-Provisioning with Universal Device/Line Templates, with BAT CSV imports, or with single-use 16-digit activation codes (CUCM 12.5(1) and later, valid one week by default; Webex devices use Control Hub activation codes).
Last updated: October 2026
3.4 Endpoint Deployment, Onboarding & Troubleshooting
Deploying, provisioning, and maintaining IP endpoints is a cornerstone of enterprise collaboration operations. To effectively deploy and troubleshoot collaboration networks, administrators must master the precise boot sequence of Cisco IP phones, understand automated provisioning methodologies, and diagnose root causes when registration fails.
1. Cisco IP Phone Bootup & Registration Lifecycle
When a Cisco IP Phone is plugged into an enterprise switch port, it undergoes an 8-stage deterministic boot sequence : [Stage 1: Power (PoE)]
- │
- [Stage 2: Voice VLAN Discovery (CDP / LLDP-MED)]
- │
- [Stage 3: DHCP Lease & Option 150 TFTP Acquisition]
- │
- [Stage 4: Trust Verification (CTL / ITL Retrieval)]
- │
- [Stage 5: Configuration File Download (SEP<MAC>.cnf.xml)]
- │
- [Stage 6: Firmware Load Verification & Flash Upgrade]
- │
- [Stage 7: SIP Registration (REGISTER -> 401 Challenge -> 200 OK)]
- │
- [Stage 8: Keepalive Maintenance (OPTIONS / Periodic re-REGISTER)]
- Stage-by-Stage Breakdown
- Stage 1: Power Delivery (PoE)
The switch port supplies inline power via IEEE 802.3af (PoE up to 15.4W), IEEE 802.3at (PoE+ up to 30W), IEEE 802.3bt (up to 60W/90W for video systems), or legacy Cisco pre-standard inline power.
Stage 2: VLAN Discovery (CDP / LLDP-MED)
The phone uses Cisco Discovery Protocol (CDP) or Link Layer Discovery Protocol - Media Endpoint Discovery (LLDP-MED) to discover the voice VLAN configured on the switch port (e.g., switchport voice vlan 110 ). The switch instructs the phone to tag voice packets with an 802.1Q tag carrying a Priority Code Point (PCP) of CoS 5 .
Stage 3: DHCP Lease & Option 150
The phone issues a DHCP Discover broadcast within the voice VLAN. The DHCP server responds with an IP address, subnet mask, default gateway, DNS server(s), and DHCP Option 150 :
Option 150 (Cisco Proprietary): Returns a list/array of TFTP server IP addresses (e.g., primary TFTP 10.1.1.10 , secondary TFTP 10.1.1.11 ).
Option 66 (RFC Standard): Returns only a single TFTP server IP address or fully qualified domain name (FQDN).
Stage 4: Trust Verification (CTL & ITL Retrieval)
The phone queries the TFTP server for security trust list files:
CTLFile.tlv (Certificate Trust List, used when CUCM cluster is in Mixed Mode).
ITLFile.tlv (Identity Trust List, used in both Non-Secure and Mixed Mode).
The ITL file binds the phone to the CUCM cluster by storing public certificates for the CallManager nodes, TFTP service, and Certificate Authority Proxy Function (CAPF).
Stage 5: Configuration File Download
The phone issues a TFTP request for its device configuration file: SEP<MAC_ADDRESS>.cnf.xml.sgn (signed by the TFTP private key) or .enc.sgn (encrypted). This XML payload defines:
Priority list of CUCM call-processing nodes (the CallManager Group: primary, secondary, tertiary).
Transport protocol (TCP, UDP, or TLS on port 5060/5061).
Firmware load name ( <loadInformation> ).
Directory numbers, speed dials, line button templates, and softkey configurations.
Stage 6: Firmware Load Verification
The phone compares the <loadInformation> string in the XML file against its current operational firmware stored in local flash memory. If the versions differ, the phone downloads the new firmware images ( .bin , .sbn , or .loads ) via TFTP, flashes its memory, and reboots.
Stage 7: SIP Registration
The phone initiates a SIP REGISTER request to the primary CUCM subscriber node identified in its CallManager Group:
If digest authentication is configured, CUCM challenges with 401 Unauthorized containing a nonce.
The phone recalculates the MD5 response and resends the REGISTER with an Authorization: header.
CUCM validates the device and answers 200 OK with Expires: 120 (the SIP Station KeepAlive Interval service parameter), even though the phone asked for 3600 seconds.
Stage 8: Keepalive Maintenance
The phone re-registers shortly before the 120-second registration expires (about every 115 seconds, because the SIP Profile's Timer Register Delta is 5 seconds) and keeps a standby registration with its backup subscriber so it can fail over quickly.
2. CUCM Endpoint Deployment Methodologies
CUCM provides three primary provisioning workflows:
1. Manual Device & Line Configuration
Workflow: An administrator navigates to Device > Phone > Add New , selects the phone model and protocol (SIP), enters the 12-character MAC address, assigns a Device Pool, Phone Button Template, and Calling Search Space (CSS), and manually configures Directory Numbers (DNs).
Use Case: Best suited for individual moves, adds, and changes (MACs), executive devices, or lab testing.
2. Self-Provisioning
Workflow: Allows unassigned phones to be staged with zero manual MAC address entry.
The administrator enables the Self-Provisioning IVR service and configures a Universal Device Template (UDT) and Universal Line Template (ULT) .
When an unassigned phone boots, CUCM auto-registers the phone into a restricted "Auto-Registration" partition with access only to the Self-Provisioning IVR.
The end user dials the IVR pilot number, authenticates with their User ID and Self-Service PIN.
CUCM automatically binds the physical phone's MAC address to the user's provisioned line template and profile, promoting it to full operational status.
Use Case: Large-scale campus deployments where physical technicians plug in phones without pre-mapping MAC addresses.
3. Bulk Administration Tool (BAT)
Workflow: Automates mass provisioning for hundreds or thousands of devices using comma-separated value (CSV) files and pre-built templates.
Download the Microsoft Excel template ( BAT.xlt ) from CUCM.
Populate phone attributes, MAC addresses, directory numbers, and user associations.
Export to CSV and upload to CUCM under Bulk Administration > Upload/Download Files .
Create a Phone Template defining common settings (device pool, softkey template, CSS).
Schedule the Insert Phones bulk job and monitor execution logs via the Job Scheduler.
- 3. Webex Cloud Endpoint Onboarding
- 16-Digit Activation Codes
For cloud-native deployments (Webex Calling and Webex Meetings), devices such as Cisco Room Series, Webex Desk Series, and Cisco 8800/9800 Cloud-capable Multiplatform Phones (MPP) onboard via Control Hub :
An administrator creates a Workspace or User in Webex Control Hub and selects Add Device > Cisco Webex Room Device .
Control Hub generates a 16-digit one-time activation code (valid for 7 days by default).
When the physical endpoint boots, the setup wizard prompts for the activation code.
The device opens an outbound HTTPS (TCP 443) and Secure WebSocket (WSS) connection to the Webex Cloud, validates the activation code, downloads cloud provisioning parameters, retrieves its latest RoomOS firmware, and registers securely.
Webex Edge for Devices
A hybrid onboarding model where Cisco video devices remain registered on-premises to CUCM for core call routing, but establish a secure outbound mutual-TLS connection to Webex Cloud. This grants Control Hub management, device analytics, advanced workspace telemetry, and cloud-driven hybrid meetings without migrating on-premises call control.
Activation Code Onboarding on CUCM (Blueprint 2.1.d)
Since CUCM 12.5(1), phones can be onboarded without collecting MAC addresses:
Add the phone with a placeholder MAC address (or through BAT), check Require Activation Code for Onboarding , and associate the owner user.
CUCM generates a single-use 16-digit activation code that expires after one week by default. A user who owns the phone can also see the code in the Self Care Portal, and that access is audit-logged.
The user enters the code on a supported 7800 or 8800 Series phone. The phone registers and CUCM replaces the placeholder MAC with the real one.
For phones outside the network, activation code onboarding over MRA (CUCM 12.5(1)SU1 or later, Expressway X12.5 or later, and Smart Licensing) uses Cisco's cloud onboarding service, so CUCM must be able to resolve and reach Webex domains such as activation.webex.com .
Webex App and Jabber as CUCM Soft Clients (Blueprint 2.1.e)
When Webex App or Jabber uses CUCM for calling, each platform needs its own device record associated with the user:
- Device type Platform
- CSF (Client Services Framework) Windows and macOS desktop
- BOT Android phone
- TCT iPhone
- TAB Tablet (iPad or Android)
The client finds CUCM through the _cisco-uds._tcp SRV record on the corporate network or _collab-edge._tls over MRA, and a UC service profile supplies voicemail, directory, and IM and Presence settings. In Webex Calling, by contrast, the Webex App registers directly to the cloud under the user's Professional or Standard license.
4. Troubleshooting Registration Failures
When an IP phone fails to register, the phone screen and CUCM event logs display specific symptoms:
Phone Display / Status Root Cause Analysis Remediation Procedure
"Configuring IP" DHCP failure: Voice VLAN not providing DHCP responses, pool exhausted, or switch port misconfigured. Verify switch voice VLAN configuration ( show vlan , show lldp info remote-device ). Verify DHCP scope has free leases and default gateway is reachable.
"TFTP File Not Found" TFTP failure: Phone requests SEP<MAC>.cnf.xml , but the file is missing from the TFTP directory, or TFTP service is stopped. Verify Cisco TFTP service is running in Cisco Unified Serviceability. Verify MAC address in CUCM matches physical device label. Re-save and apply phone configuration in CUCM.
"Trust List Update Failed" ITL/CTL Mismatch: The phone has an existing ITL file signed by an old CallManager/TFTP certificate, but the current TFTP server presents a different certificate. The phone refuses new configuration files. Delete the ITL file on the phone: Settings > Admin Settings > Reset Settings > Security Settings (or perform a hardware factory reset).
SIP 401 Unauthorized SIP Digest Authentication failure: Credentials provided by the phone do not match the end-user digest credentials in CUCM. Verify phone SIP Digest User configuration under Phone configuration. Check End User digest password in CUCM Admin.
SIP 403 Forbidden Authorization failure: The phone's MAC address is not configured in CUCM, Auto-Registration is disabled, or node is unlisted in CM Group. Add the phone MAC address to CUCM, or enable Auto-Registration on the primary subscriber node. Verify the phone is contacting a node listed in its CallManager Group.
One-Way Audio / Dead Air Asymmetric routing, NAT traversal failure, or firewall blocking RTP UDP media ports (default range 16384–32767). Verify routing paths between endpoints. Disable SIP ALG on intermediate firewalls. Ensure UDP media ports are open bidirectionally. Check for MTP allocation.
Hardware Factory Reset Sequence
When an endpoint experiences corrupted ITL files or firmware freezes, execute a hardware factory reset:
Unplug the Ethernet cable (or power supply).
Hold down the # key while reconnecting power.
Continue holding # until the headset and speaker buttons blink alternately in amber/red.
Release # and enter the following key sequence on the keypad: 1 2 3 4 5 6 7 8 9 * 0 # .
The phone re-initializes its flash memory, erases security certificates and ITL files, and reboots to stage 1.