index.md

CSM Troubleshooting Information

This document provides links to troubleshooting information for services and functionality provided by CSM.

Known Issues

• Known Issues
  • SAT/HSM/CAPMC Component Power State Mismatch
  • HMS Discovery job not creating RedfishEndpoints in Hardware State Manager
  • initrd.img.xz not found
  • SSL Certificate Validation Issues

Troubleshooting Topics

• Kubernetes
  • General Kubernetes Commands for Troubleshooting
  • Kubernetes Log File Locations
  • Liveliness or Readiness Probe Failures
  • Unresponsive kubectl Commands
  • Kubernetes Node NotReady
  • Kubernetes Pods not Starting
  • Postgres Database
  • Recover from Postgres WAL Event
  • Restore Postgres
  • Disaster Recovery for Postgres
• UAS Issues
  • Viewing UAI Log Output
  • Stale Brokered UAIs
  • UAI Stuck in ContainerCreating
  • Duplicate Mount Paths in a UAI
  • Missing or Incorrect UAI Images
  • Common Mistakes When Creating a Custom End-User UAI Image
• Boot Issues
  • UAN Boot Issues
  • Compute Node Boot Issues
    • Issues Related to Unified Extensible Firmware Interface (UEFI)
    • Issues Related to Dynamic Host Configuration Protocol (DHCP)
    • Issues Related to the Boot Script Service
    • Issues Related to Trivial File Transfer Protocol (TFTP)
    • Troubleshooting Using Kubernetes
    • Log File Locations and Ports Used
    • Issues Related to Slow Boot Times
• Compute Rolling Upgrades
  • Nodes Failing to Upgrade in a CRUS Session
  • Failed CRUS Session Because of Unmet Conditions
  • Failed CRUS Session Because of Bad Parameters
• Configuration Management
  • Ansible Play Failures in CFS Sessions
  • CFS Session Failing to Complete
• Security and Authentication
  • Common Vault Cluster Issues
• ConMan
  • ConMan Blocking Access to a Node BMC
  • ConMan Failing to Connect to a Console
  • ConMan Asking for Password on SSH Connection
• Utility Storage
  • Failure to Get Ceph Health
  • Down OSDs
  • Ceph OSDs Reporting Full
  • System Clock Skew
  • Unresponsive S3 Endpoint
  • Ceph-Mon Processes Stopping and Exceeding Max Restarts
  • Large Object Map Objects in Ceph Health
  • Failure of RGW Health Check
• Node Management
  • Issues with Redfish Endpoint DiscoveryCheck for Redfish Events from Nodes
  • Interfaces with IP Address Issues
  • Loss of Console Connections and Logs on Gigabyte Nodes
• Customer Access Network (CAN)
  • CAN Issues
• Domain Name Service (DNS)
  • Connectivity to Services with External IP addresses
  • DNS Configuration Issues
• MetalLB in BGP-Mode
  • Services Without an Allocated IP Address
  • BGP not Accepting Routes from MetalLB
• Spire
  • Restore Spire Postgres without a Backup
  • Spire Failing to Start on NCNs