Prism Element
Prism Element Dashboard概要
PE控制台也稱為 Prism Element，可提供圖形使用者界面管理 Nutanix 叢集中的大多數活動。Prism控制台的畫面分為以下幾個板塊：
-
主選單欄 : 主選單欄位於 Prism控制台中每個畫面的頂部。叢集的名稱出現在主選單欄的最左側。在叢集名稱的右側，可以從下拉列表( Home, Health, VM, Storage, Hardware, DR, Analysis, 和 Alerts等等中)中選擇實體，以顯示有關該實體的資訊。還可以從主選單欄右側的下拉列表中搜索特定主題或選擇各種任務。此外，主選單欄還包括各種狀態圖標，用於快速存取運行狀況、警示和事件資訊。
-
實體視圖 : 每一個實體都有一個儀表板視圖。部分實體( VM, Storage, Hardware, and Data Protection )還包括額外的視圖，例如圖表或表格視圖，可以從實體的儀表板中選擇。
-
畫面選單欄 : 部分實體儀表板的主選單下方還包含另一個選單，用於提供特定於該畫面的選項。以下示例來自Storage儀表板，該選單欄上出現有三個視圖分頁(Overview、Diagram和Table)和三個任務按鈕(+ Storage Container、+ Volume Group和+ Storage Pool)。
-
使用狀況和效能/健康統計 : 大部分視圖都包含各種圖表，用於提供有關使用與效能或運行狀況(或二者兼具)的統計資訊。根據查看的實體，其使用狀況和效能/運行狀況統計資訊各有不同。例如，VM的使用統計資訊會按 CPU 和記憶體兩方面內容來顯示，而磁碟使用率統計資訊則以 TB 為單位顯示磁碟容量。在大多數情況下，效能統計資訊表現為 IOPS、延遲和頻寬三個方面。
-
警報和事件訊息 : 一些視圖中會包括列出當前事件和警示訊息的統計。所列出的訊息特定於各自情景，例如，Storage畫面中只會出現與Storage相關的警示和事件。點擊訊息，即可打開該訊息中警示或事件的相應視圖
點擊"叢集名稱"可以修改叢集細節
- 在 Cluster Name 欄位中，輸入（或更新）叢集的名稱。
- 在 FQDN 欄位中，輸入集群的完全限定功能變數名稱 （FQDN）。
- 在 Virtual IP 字段中，輸入將用作叢集虛擬 IP 的 IP 位址。
- 在 ISCSI 資料服務 IP 位址欄位中，輸入（或更新）用於 Nutanix 卷和其他資料服務應用程式的 IP 位址。
- Retain Deleted VMs，勾選啟用回收站保留已刪除的虛擬機 24 小時。
調整Virtual IP或是ISCSI資料服務IP會導致叢集某些服務功能受影響，需警慎評估。
Storage Summary
預設使用率(含容錯N+1)告警為75%
Storage Summary -> View Details說明
Data Resiliency Status
確認資料冗餘的狀態，本配置為自動的
除了可用空間容錯以外，當叢集元件無法容錯時，此狀態也會變成Critical
Rebuild Progress 表示自動再重建資料。
上圖展示了異常與正常之狀態; 左邊為正常，右邊為異常
Prism Element 選單
從左側的下拉列表中選擇視圖(實體名稱)會顯示有關該實體的資訊。 從以下選項中選擇：
- Home: 顯示主儀表板。
- Health: 顯示運行狀況儀表板。
- VM: 顯示虛擬機器資訊儀表板。
- Storage: 顯示儲存資訊儀表板。
- Network (僅限 AHV): 顯示網路可視化工具。
- Hardware: 顯示硬體資訊儀表板。
- File Server: 顯示檔案伺服器儀表板。
- Data Protection: 顯示資料保護資訊儀表板。
- Analysis: 顯示用於創建和運行效能監視器的界面。
- Alerts: 顯示警示和事件訊息畫面。
- Tasks: 顯示任務訊息的畫面。
- LCM: 顯示生命週期管理器(LCM)儀表板。
- Settings: 如同點擊主選單右側的齒輪圖標一樣，將顯示設置選單。
Prism Element -> Health
健康監控提供一系列狀態檢查來監控叢集的運作狀況。
NCC
一種檢查數百個項目的整體健康的機制，當叢集中發現問題時，請先執行它來做故障排除。
- 實際是一組腳本
- 檢查結果用於產生警告、輸出健康資訊到文字檔案中、顯示Health(健康)選單等。
- 建議每週運行並透過電子郵件接收報告
由於NCC本身是軟體功能，建議保持升級到最新版本，維持檢查健康機制來確認叢集健康非常重要。
在開Case時除錯和LCM升級前後等維護我們都會執行NCC Health Checks 檢查叢集健康狀態
Health -> Actions -> Run NCC Checks
All Checks -> Run
Tasks -> 找到Health Check的排程 -> Succeeded -> Download Output即可下載檢測的日誌
日誌是一個txt檔如下
ncc-output-2024-11-22-1732257928-NX1365G6PE.txt
打開後如下
NCC Health Checks Summary
################################################################################
SUMMARY
################################################################################
+-----------------------+
| State | Count |
+-----------------------+
| Error | 1 |
| Fail | 2 |
| Warning | 6 |
| Info | 3 |
| Pass | 256 |
| Total Plugins | 268 |
+-----------------------+
################################################################################
DETAILED INFORMATION
################################################################################
Detailed information for disk_status_check:
Node 172.16.90.66:
ERR : Execution terminated by exception KeyError(177)
ERR : Unknown Exception occurred during execution
Refer to KB 8094 (http://portal.nutanix.com/kb/8094) for details on disk_status_check
Detailed information for remote_site_config_check:
Node 172.16.90.66:
FAIL: Local site NX1365G6PE is not configured on the remote site R630CE
Refer to KB 3335 (http://portal.nutanix.com/kb/3335) for details on remote_site_config_check
Detailed information for vg_space_usage_check:
Node 172.16.90.65:
FAIL: Volume Group silver_ntnxobject-af59de-default-0 space usage (96 %) above 90 %
FAIL: Volume Group pvc-2ecf546e-ed0c-4726-a1fa-cb871e2f12b9 space usage (92 %) above 90 %
FAIL: Volume Group pvc-aea53300-9891-41d5-bd18-6fa1839b3f42 space usage (91 %) above 90 %
Node 172.16.90.66:
FAIL: Volume Group pvc-74574bed-c2d8-4996-bd3f-6c8c78bb42d5 space usage (93 %) above 90 %
WARN: Volume Group pvc-606aef47-bc3b-4bf0-8aca-ce6d60ec210c space usage (76 %) above 75 %
FAIL: Volume Group pvc-11e6aaa6-e718-4d77-a488-d157d86bfc38 space usage (93 %) above 90 %
FAIL: Volume Group pvc-010f8e31-be0f-4771-8e1b-8500877a2009 space usage (90 %) above 90 %
Refer to KB 4600 (http://portal.nutanix.com/kb/4600) for details on vg_space_usage_check
Detailed information for remote_site_has_correct_cluster_info_check:
Node 172.16.90.66:
WARN:
cluster_id or cluster_incarnation_id has been changed for the remote node with IP 172.16.111.123
Refer to KB 4505 (http://portal.nutanix.com/kb/4505) for details on remote_site_has_correct_cluster_info_check
Detailed information for backup_schedule_check:
Node 172.16.90.66:
WARN: Backup schedule does not exist for protection domain Casper-Test protecting some entities. If this protection domain is created for use by backup software, this warning can be ignored.
WARN: Backup schedule does not exist for protection domain Libra-test protecting some entities. If this protection domain is created for use by backup software, this warning can be ignored.
Refer to KB 1910 (http://portal.nutanix.com/kb/1910) for details on backup_schedule_check
Detailed information for remote_site_connectivity_check:
Node 172.16.90.66:
WARN: Failed to connect to the remote site R630CE. Unable to reach port 2009 or 2020 on the remote site.
Refer to KB 1596 (http://portal.nutanix.com/kb/1596) for details on remote_site_connectivity_check
Detailed information for check_license_compliance:
Node 172.16.90.66:
WARN: Features not permitted by license(s) applied are being used. Non compliant features:
dr_multiple_remote_sites | DR Configuration:more than 2 remote sites (or) more than 1 DR remote site enabled
File Level Restore |Vm with uuid 34035ac7-ce9b-490d-884e-ba8c40f409d2:File Level Restore enabled
Refer to KB 2469 (http://portal.nutanix.com/kb/2469) for details on check_license_compliance
Detailed information for host_cpu_contention:
Node 172.16.90.65:
WARN: High host CPU utilization on host 172.16.90.55: 91 (Threshold: 75).
Node 172.16.90.66:
WARN: High host CPU utilization on host 172.16.90.56: 94 (Threshold: 75).
Node 172.16.90.67:
WARN: High host CPU utilization on host 172.16.90.57: 92 (Threshold: 75).
Refer to KB 2797 (http://portal.nutanix.com/kb/2797) for details on host_cpu_contention
Detailed information for remote_site_has_virtual_ip_check:
Node 172.16.90.66:
WARN: This cluster is not configured with it's Virtual IP on remote NX3500PE. Please update the remote site configuration on remote NX3500PE with this cluster's Virtual IP.
Refer to KB 3024 (http://portal.nutanix.com/kb/3024) for details on remote_site_has_virtual_ip_check
Detailed information for orphan_vm_snapshot_check:
Node 172.16.90.66:
INFO: Found 1 orphan VM snapshot(s): ['38f09a03-9d10-4629-a918-35083880bb70'].
Refer to KB 3752 (http://portal.nutanix.com/kb/3752) for details on orphan_vm_snapshot_check
Detailed information for check_cvm_ssh_security:
Node 172.16.90.65:
INFO: Password-based remote login is enabled on the cluster. It is recommended to use key-based ssh access instead of password-based ssh access for better security.
Node 172.16.90.66:
INFO: Password-based remote login is enabled on the cluster. It is recommended to use key-based ssh access instead of password-based ssh access for better security.
Node 172.16.90.67:
INFO: Password-based remote login is enabled on the cluster. It is recommended to use key-based ssh access instead of password-based ssh access for better security.
Refer to KB 14104 (http://portal.nutanix.com/kb/14104) for details on check_cvm_ssh_security
Detailed information for ngt_installer_version_check:
Node 172.16.90.66:
INFO: Following VMs do not have latest NGT version installed:
VM: Arthur_Jump - NGT installed version: 2.0.1, NGT latest version: 4.1.1
VM: Arthur_Jump102 - NGT installed version: 2.3.2, NGT latest version: 4.1.1
Refer to KB 5487 (http://portal.nutanix.com/kb/5487) for details on ngt_installer_version_check
One or more plugins generated ERROR as the check execution couldn't be completed. Please re-run the check individually or reach out to Nutanix Support.
################################################################################
PLUGIN RESULTS
################################################################################
/health_checks/hardware_checks/disk_checks/disk_status_check [ ERR ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_config_check [ FAIL ]
/health_checks/hardware_checks/disk_checks/vg_space_usage_check [ FAIL ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_has_correct_cluster_info_check [ WARN ]
/health_checks/data_protection_checks/protection_domain_checks/backup_schedule_check [ WARN ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_connectivity_check [ WARN ]
/health_checks/system_checks/check_license_compliance [ WARN ]
/health_checks/hypervisor_checks/host_cpu_contention [ WARN ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_has_virtual_ip_check [ WARN ]
/health_checks/hypervisor_checks/orphan_vm_snapshot_check [ INFO ]
/health_checks/system_checks/check_cvm_ssh_security [ INFO ]
/health_checks/ngt_checks/ngt_installer_version_check [ INFO ]
/health_checks/system_checks/cvm_name_check [ PASS ]
/health_checks/network_checks/duplicate_cvm_ip_check [ PASS ]
/health_checks/system_checks/zkalias_check_plugin [ PASS ]
/health_checks/hardware_checks/disk_checks/disk_id_duplicate_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_licensing_check [ PASS ]
/health_checks/system_checks/storage_tier_check [ PASS ]
/health_checks/hardware_checks/disk_checks/disk_usage_check [ PASS ]
/health_checks/pulse_checks/cfs_fatal_check [ PASS ]
/health_checks/robo_checks/robo_cluster_nodes_ping_check [ PASS ]
/health_checks/system_checks/check_host_password_expiry [ PASS ]
/health_checks/network_checks/duplicate_hypervisor_ip_check [ PASS ]
/health_checks/hardware_checks/disk_checks/sata_controller_check [ PASS ]
/health_checks/system_checks/default_password_check [ PASS ]
/health_checks/system_checks/check_vm_pinning_config [ PASS ]
/health_checks/system_checks/dense_node_minimum_cvm_configuration_checks [ PASS ]
/health_checks/robo_checks/robo_witness_configured_check [ PASS ]
/health_checks/hypervisor_checks/ahv_file_integrity_check [ PASS ]
/health_checks/system_checks/coreoff_check [ PASS ]
/health_checks/network_checks/zeus_config_ip_address_check [ PASS ]
/health_checks/hypervisor_checks/ahv_cvm_startup_dependency_check [ PASS ]
/health_checks/stargate_checks/oplog_index_memory_usage_check [ PASS ]
/health_checks/system_checks/sp_usage_check [ PASS ]
/health_checks/system_checks/user_space_process_count [ PASS ]
/health_checks/hardware_checks/disk_checks/storage_pool_space_usage_check [ PASS ]
/health_checks/system_checks/fs_inconsistency_check [ PASS ]
/health_checks/network_checks/ns_config_consistency_check [ PASS ]
/health_checks/data_protection_checks/cloud_checks/cloud_remote_check [ PASS ]
/health_checks/system_checks/alert_manager_service_check [ PASS ]
/health_checks/network_checks/cvm_dvportgroup_binding_check [ PASS ]
/health_checks/stargate_checks/compression_disabled_check [ PASS ]
/health_checks/hypervisor_checks/vm_checks [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/multiple_file_server_versions_check [ PASS ]
/health_checks/system_checks/notifications_dropped_check [ PASS ]
/health_checks/network_checks/ofpfmfc_table_full_check [ PASS ]
/health_checks/system_checks/hostname_resolution_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_container_check [ PASS ]
/health_checks/hypervisor_checks/ahv_bridge_config_check [ PASS ]
/health_checks/system_checks/crash_dump_check [ PASS ]
/health_checks/data_protection_checks/ahv_sync_rep_checks/ports_open_check [ PASS ]
/health_checks/stargate_checks/node_storage_tier_skew_check [ PASS ]
/health_checks/hardware_checks/dimm_checks/dimm_sel_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/protected_vms_cbr_incapable_check [ PASS ]
/health_checks/system_checks/cluster_active_upgrade_check [ PASS ]
/health_checks/network_checks/mellanox_nic_mixed_family_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/ssd_snapshot_reserve_space_check [ PASS ]
/health_checks/network_checks/host_cvm_subnets_check [ PASS ]
/health_checks/hypervisor_checks/ahv_version_check [ PASS ]
/health_checks/draas_checks/protection_policy_checks/recovery_point_limit_exceeding_check [ PASS ]
/health_checks/network_checks/fanout_secure_port_connection_pe_to_pc_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_vg_check [ PASS ]
/health_checks/system_checks/cvm_memory_check [ PASS ]
/health_checks/system_checks/dns_server_check [ PASS ]
/health_checks/system_checks/snapshot_chain_height_check [ PASS ]
/health_checks/hardware_checks/disk_checks/ssd_configuration_check [ PASS ]
/health_checks/hardware_checks/bmc_bios_version_check [ PASS ]
/health_checks/hardware_checks/disk_checks/disk_storage_pool_check [ PASS ]
/health_checks/hardware_checks/chassis_cpus_type_check [ PASS ]
/health_checks/robo_checks/robo_witness_state_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/vstore_cg_file_count_check [ PASS ]
/health_checks/key_manager_checks/sw_encryption_key_availability_check [ PASS ]
/health_checks/network_checks/cvm_network_error_check [ PASS ]
/health_checks/hypervisor_checks/cvm_memory_reservation_check [ PASS ]
/health_checks/system_checks/virtual_ip_check [ PASS ]
/health_checks/network_checks/cvm_mtu_uniformity_check [ PASS ]
/health_checks/stargate_checks/list_containers_with_conversion_to_aes_in_progress [ PASS ]
/health_checks/system_checks/cvm_same_ncc_version_check [ PASS ]
/health_checks/data_protection_checks/remote_site_checks/dr_service_reachability_check [ PASS ]
/health_checks/system_checks/rsyslog_connectivity_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_cvm_config_check [ PASS ]
/health_checks/stargate_checks/container_on_removed_storage_pool [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/aged_entity_centric_third_party_backup_snapshot_check [ PASS ]
/health_checks/sar_checks/ssd_latency_threshold_check [ PASS ]
/health_checks/network_checks/ahv_secondary_ip_ping_check [ PASS ]
/health_checks/hardware_checks/ipmi_checks/power_supply_issues_check [ PASS ]
/health_checks/network_checks/network_controller_host_certs_expiry_check [ PASS ]
/health_checks/system_checks/kernel_mitigations_check [ PASS ]
/health_checks/network_checks/fns_pe_upgrade_prechecks [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_stale_db_check [ PASS ]
/health_checks/stargate_checks/garbage_egroups_size_check [ PASS ]
/health_checks/hardware_checks/disk_checks/host_disk_usage_check [ PASS ]
/health_checks/key_manager_checks/active_kmip_servers_check [ PASS ]
/health_checks/system_checks/cvm_reboot_check [ PASS ]
/health_checks/hypervisor_checks/host_rx_packets_drop [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/unsupported_vm_config_vstore_check [ PASS ]
/health_checks/hypervisor_checks/ahv_rpmdb_integrity_check [ PASS ]
/health_checks/network_checks/10gbe_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/snapshot_file_location_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/storage_container_mount_check [ PASS ]
/health_checks/hardware_checks/ipmi_checks/power_supply_check [ PASS ]
/health_checks/network_checks/bond_uplink_usability_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/metro_vstore_symlinks_check [ PASS ]
/health_checks/draas_checks/vm_recovery_container_mount_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/diverged_recovery_points_check [ PASS ]
/health_checks/network_checks/switch_checks/ovs_bond_config [ PASS ]
/health_checks/system_checks/cpu_unblock_check [ PASS ]
/health_checks/pulse_checks/metering_rest_connection_checks [ PASS ]
/health_checks/hardware_checks/disk_checks/unreserved_available_space_check [ PASS ]
/health_checks/system_checks/rsyslog_forwarding_check [ PASS ]
/health_checks/network_checks/check_unsupported_sfp [ PASS ]
/health_checks/system_checks/degraded_node_check [ PASS ]
/health_checks/system_checks/cvm_services_status [ PASS ]
/health_checks/system_checks/http_proxy_check [ PASS ]
/health_checks/network_checks/check_ntp [ PASS ]
/health_checks/system_checks/node_schedulable_check [ PASS ]
/health_checks/cassandra_checks/cassandra_keyspace_cf_check [ PASS ]
/health_checks/system_checks/check_erasure_code_config [ PASS ]
/health_checks/network_checks/host_pingable_check [ PASS ]
/health_checks/hardware_checks/ipmi_checks/mixed_psu_check [ PASS ]
/health_checks/network_checks/ahv_duplicate_secondary_ip_check [ PASS ]
/health_checks/hardware_checks/m10_gpu_check [ PASS ]
/health_checks/network_checks/ovs_congestion_status_check [ PASS ]
/health_checks/network_checks/check_interface_configuration_files [ PASS ]
/health_checks/self_encrypting_drive_checks/disk_configuration_vs_intent_consistency_check [ PASS ]
/health_checks/stargate_checks/list_vms_with_qos_attrs [ PASS ]
/health_checks/system_checks/weekly_pre_expiry [ PASS ]
/health_checks/system_checks/rf1_container_check [ PASS ]
/health_checks/hardware_checks/disk_checks/m2_boot_disk_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/multiple_fsvm_on_single_node_check [ PASS ]
/health_checks/metro_availability_checks/secondary_metro_pd_in_sync_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/invalid_vm_name_check [ PASS ]
/health_checks/network_checks/host_nic_error_check [ PASS ]
/health_checks/system_checks/same_timezone_check [ PASS ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_time_sync_check [ PASS ]
/health_checks/system_checks/daily_pre_expiry [ PASS ]
/health_checks/system_checks/cluster_services_down_check [ PASS ]
/health_checks/network_checks/ahv_host_mtu_check [ PASS ]
/health_checks/hardware_checks/disk_checks/disk_online_check [ PASS ]
/health_checks/system_checks/zkinfo_check_plugin [ PASS ]
/health_checks/hypervisor_checks/gpu_driver_installed_check [ PASS ]
/health_checks/metro_availability_checks/metro_automatic_checkpoint_snapshot_check [ PASS ]
/health_checks/system_checks/check_ssl_expiry [ PASS ]
/health_checks/system_checks/cvm_connectivity [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_upgrade_task_stuck_check [ PASS ]
/health_checks/system_checks/remote_support_status_check [ PASS ]
/health_checks/system_checks/cluster_disabled_upgrade_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_default_password_check [ PASS ]
/health_checks/network_checks/conntrack_mode_check [ PASS ]
/health_checks/system_checks/ergon_checks [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_remote_site_status_check [ PASS ]
/health_checks/hypervisor_checks/ahv_read_only_fs_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/nvm_cpu_checks [ PASS ]
/health_checks/key_manager_checks/node_certificate_expiry_check [ PASS ]
/health_checks/system_checks/vdisk_count_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/snapshot_missing_entities_check [ PASS ]
/health_checks/cassandra_checks/cassandra_sstable_health_warning_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/duplicate_vm_names_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/recovery_point_availability_check [ PASS ]
/health_checks/hardware_checks/disk_checks/raid_health_check [ PASS ]
/health_checks/system_checks/aide_check [ PASS ]
/health_checks/hypervisor_checks/ahv_crash_file_check [ PASS ]
/health_checks/metro_availability_checks/metro_stale_snapshot_check [ PASS ]
/health_checks/network_checks/ndp_check [ PASS ]
/health_checks/hardware_checks/disk_checks/metadata_mounted_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/stale_app_consistent_snapshot_metadata_chunks_check [ PASS ]
/health_checks/system_checks/email_alerts_check [ PASS ]
/health_checks/network_checks/ipv6_config_check [ PASS ]
/health_checks/system_checks/check_node_ssh_keys [ PASS ]
/health_checks/system_checks/password_expiry_check [ PASS ]
/health_checks/system_checks/ngt_ca_setup_check [ PASS ]
/health_checks/data_protection_checks/remote_site_checks/remote_site_mtu_check [ PASS ]
/health_checks/hardware_checks/hardware_ratio_check_module [ PASS ]
/health_checks/system_checks/snapshot_space_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/pd_clones_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_status_check [ PASS ]
/health_checks/network_checks/ahv_dvs_config_consistency_check [ PASS ]
/health_checks/pulse_checks/pulse_enablement_checks [ PASS ]
/health_checks/network_checks/nic_link_down_check [ PASS ]
/health_checks/system_checks/host_connectivity [ PASS ]
/health_checks/system_checks/ldap_config_check [ PASS ]
/health_checks/system_checks/gflags_diff_check [ PASS ]
/health_checks/system_checks/calm_version_mismatch_check [ PASS ]
/health_checks/key_manager_checks/pc_kms_availability_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/cross_hypervisor_ngt_installed_check [ PASS ]
/health_checks/stargate_checks/dedup_auto_disabled_check [ PASS ]
/health_checks/key_manager_checks/sed_key_availability_check [ PASS ]
/health_checks/system_checks/cluster_node_count [ PASS ]
/health_checks/hypervisor_checks/hwclock_check [ PASS ]
/health_checks/metro_availability_checks/unsupported_vm_config_check [ PASS ]
/health_checks/network_checks/conntrack_connection_limit_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/replication_of_deduped_entities_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/linked_clones_in_nearsync_pds_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/protected_vg_whitelist_check [ PASS ]
/health_checks/system_checks/dense_node_configuration_checks [ PASS ]
/health_checks/system_checks/check_virtual_ip_is_in_cluster_external_subnet [ PASS ]
/health_checks/ngt_checks/ngt_client_cert_expiry_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/maximum_entities_in_consistency_group_check [ PASS ]
/health_checks/sar_checks/hdd_latency_threshold_check [ PASS ]
/health_checks/system_checks/idf_db_to_db_sync_heartbeat_status_check [ PASS ]
/health_checks/system_checks/secure_boot_check [ PASS ]
/health_checks/key_manager_checks/ca_certificate_expiry_check [ PASS ]
/health_checks/system_checks/high_frequency_snapshotting_ssd_config_compatibility_check [ PASS ]
/health_checks/system_checks/cpu_avx_check [ PASS ]
/health_checks/cassandra_checks/cassandra_log_crash_check [ PASS ]
/health_checks/hardware_checks/factory_config_validation_check [ PASS ]
/health_checks/stargate_checks/usage_discrepancy_check [ PASS ]
/health_checks/network_checks/cvm_mtu_check [ PASS ]
/health_checks/stargate_checks/unresponsive_stargate_check [ PASS ]
/health_checks/cassandra_checks/ring_balance_check [ PASS ]
/health_checks/system_checks/storage_container_replication_factor_check [ PASS ]
/health_checks/robo_checks/robo_cluster_witness_sync_check [ PASS ]
/health_checks/system_checks/cluster_services_status [ PASS ]
/health_checks/hardware_checks/ipmi_checks/ipmi_sel_check [ PASS ]
/health_checks/hardware_checks/fru_fields_correctness_check [ PASS ]
/health_checks/system_checks/vg_excluded_cvm [ PASS ]
/health_checks/hardware_checks/disk_checks/lsi_firmware_rev_check [ PASS ]
/health_checks/system_checks/check_network_configuration_files [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/aged_third_party_backup_snapshot_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_version_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/nearsync_staging_area_stale_files_check [ PASS ]
/health_checks/volume_group_checks/vg_count_high_check [ PASS ]
/health_checks/network_checks/duplicate_dsip_check [ PASS ]
/health_checks/cassandra_checks/cassandra_ssd_size_check [ PASS ]
/health_checks/hypervisor_checks/ahv_gateway_check [ PASS ]
/health_checks/stargate_checks/copyupblockissue_check [ PASS ]
/health_checks/hypervisor_checks/cvm_virtual_hardware_version_check [ PASS ]
/health_checks/hardware_checks/disk_checks/inode_usage_check [ PASS ]
/health_checks/system_checks/cluster_version_check [ PASS ]
/health_checks/hardware_checks/dimm_interop_check [ PASS ]
/health_checks/cassandra_checks/nodetool_consistency_check [ PASS ]
/health_checks/system_checks/host_cpu_frequency_check [ PASS ]
/health_checks/data_protection_checks/ahv_sync_rep_checks/vm_updates_disabled_check [ PASS ]
/health_checks/hardware_checks/invalid_node_population_check [ PASS ]
/health_checks/robo_checks/robo_readonly_state_check [ PASS ]
/health_checks/system_checks/sufficient_disk_space_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/files_hosts_maximus_check [ PASS ]
/health_checks/system_checks/same_hypervisor_version_check [ PASS ]
/health_checks/pulse_checks/rest_connection_checks [ PASS ]
/health_checks/hardware_checks/disk_checks/incomplete_disk_removal_check [ PASS ]
/health_checks/hardware_checks/dimm_checks/dimm_size_reduction_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_vg_delete_check [ PASS ]
/health_checks/stargate_checks/ondisk_dedup_enabled_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_protect_status_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/pds_share_vms_check [ PASS ]
/health_checks/robo_checks/robo_cluster_witness_network_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_vlan_mode_check [ PASS ]
/health_checks/system_checks/cvm_memory_usage_check [ PASS ]
/health_checks/hypervisor_checks/ahv_remote_log_forwarding_check [ PASS ]
/health_checks/metro_availability_checks/data_locality_check [ PASS ]
/health_checks/hypervisor_checks/ahv_time_zone_check [ PASS ]
/health_checks/hardware_checks/disk_checks/storage_container_space_usage_check [ PASS ]
/health_checks/system_checks/epsilon_version_mismatch_check [ PASS ]
/health_checks/hardware_checks/disk_checks/disk_firmware_check [ PASS ]
/health_checks/system_checks/marker_files_check [ PASS ]
/health_checks/cassandra_checks/metadata_heap_size_check [ PASS ]
/health_checks/network_checks/cvm_time_drift_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/vstore_pd_file_count_check [ PASS ]
/health_checks/network_checks/mellanox_nic_status_check [ PASS ]
/health_checks/fileserver_checks/fileserver_cvm_checks/file_server_task_stuck_check [ PASS ]
/health_checks/cassandra_checks/cassandra_status_check [ PASS ]
/health_checks/network_checks/conntrack_check [ PASS ]
/health_checks/hardware_checks/dimm_checks/dimm_eppr_check [ PASS ]
/health_checks/hypervisor_checks/ahv_fs_integrity_check [ PASS ]
/health_checks/data_protection_checks/protection_domain_checks/protection_domain_file_conflict_check [ PASS ]
/health_checks/key_manager_checks/local_key_manager_unsafe_mode_check [ PASS ]
/health_checks/hardware_checks/ipmi_checks/ipmi_sensor_threshold_check [ PASS ]
/health_checks/network_checks/inter_cvm_ping_latency_check [ PASS ]
####################################################
# TIMESTAMP : Fri Nov 22 14:53:19 2024 (UTC +0800) #
####################################################
Cluster Name: NX1365G6PE
Cluster Id: 167573
Cluster UUID: 00061972-aeba-fee2-0000-000000028e95
Cluster Version: 6.8.1
NCC Version: 5.0.1.1-839ae000
CVM ID(Svmid) : 3
CVM external IP : 172.16.90.65
Hypervisor IP : 172.16.90.55
Hypervisor version : Nutanix 20230302.101026
IPMI IP : 10.0.90.6
Node serial : HM18BSXXXX82
Model : NX-1065-G6
Node Position : A
Block S/N : 18FM6JXXXX88
CVM ID(Svmid) : 4
CVM external IP : 172.16.90.66
Hypervisor IP : 172.16.90.56
Hypervisor version : Nutanix 20230302.101026
IPMI IP : 10.0.90.7
Node serial : HM195SXXXX72
Model : NX-1065-G6
Node Position : B
Block S/N : 18FM6JXXXX88
CVM ID(Svmid) : 5
CVM external IP : 172.16.90.67
Hypervisor IP : 172.16.90.57
Hypervisor version : Nutanix 20230302.101026
IPMI IP : 10.0.90.8
Node serial : HM184SXXXX08
Model : NX-1065-G6
Node Position : C
Block S/N : 18FM6JXXXX88
可以看到檢查失敗的部分，並有相對應的KB可以查找問題
Detailed information for backup_schedule_check:
Node 172.16.90.66:
WARN: Backup schedule does not exist for protection domain Casper-Test protecting some entities. If this protection domain is created for use by backup software, this warning can be ignored.
Refer to KB 1910 (http://portal.nutanix.com/kb/1910) for details on backup_schedule_check
Collect Logs
如果要下載支援日誌給原廠分析
Health -> Actions -> Collect Logs
Node Selection 收集想要的Node資訊
Log Settings 可以選擇想要收集的日誌資料
Output Preferences
- Select Duration 選擇日誌的區間
- 日誌從哪個時間點開始收集(之前或之後)
- 可以下載到本地，也可以透過其他如FTP的方式直接上傳到Support Portal
- Anonymize Output：遮蔽一些機敏資訊如IP地址
收集完成後，可以在Task -> Log Collector -> Succeeded下載日誌包
下載日誌包檔案如下
NTNX-Log-2024-11-22-29281243983-167573-PE.zip
Prism Element -> Storage
Nutanix 叢集中的儲存空間依層次結構組織為多個元件，可讓您管理容量和效能。
儲存層
每種類型的儲存硬體（SSD-PCIe (NVMe)、SSD (SATA SSD) 和 HDD）都放置在儲存層中。您可以透過 Web 控制台確定儲存池中磁碟的層細分。
儲存池
儲存池是來自一層或多層的實體磁碟組。儲存池提供實體隔離，因為儲存設備一次只能指派給單一儲存池。建立叢集時，預設的預定義儲存池可用。此池包括叢集中所有主機上所有磁碟的總容量。
儲存容器
儲存容器是儲存池中可用儲存的子集。儲存容器是在儲存池中建立的，用於保存虛擬機器使用的虛擬磁碟 (vDisk)。預設情況下，儲存是精簡配置的，這意味著在寫入資料時將實體儲存按需分配給儲存容器，而不是在建立儲存容器時分配預先定義的容量。在容器層級啟用壓縮、重複資料刪除和糾刪碼等儲存效率功能。
卷組
卷組是邏輯上相關的虛擬磁碟（或磁碟區）的集合。磁碟區組直接或使用 iSCSI 連接到 VM。您可以將虛擬磁碟新增至磁碟區群組、將它們附加到一個或多個使用者、將它們包含在災難復原策略中以及執行其他管理任務。您也可以從一個虛擬機器分離磁碟區群組並將其附加到另一虛擬機器（可能位於磁碟區組複製到的遠端位置）。
您可以在儲存容器上建立卷組，並透過以下方式之一啟用對卷組的存取：
- iSCSI :對卷組的 iSCSI 訪問是通過 Nutanix Volumes 提供。
- 如果管理程式是 AHV，則可以創建一個卷組並將其附加到一個或多個 VM 作為 SCSI 磁碟，使用 Prism Element Web 控制台、Nutanix REST API 或 nCLI 或 aCLI 命令。
一些產品、功能或解決方案可能需要通過多個 iSCSI 啟動程式(multiple iSCSI initiators)或多個 VM 連接對卷組進行同時訪問。
- Oracle RAC（裸機和虛擬化環境）
- Linux VMs
- Linux guest VM clustering (also known as RHEL HA)
- Windows Failover Clustering
- Veritas InfoScale Storage
- IBM Spectrum Scale (GPFS)
Lab: iSCSI配置
Step1 配置 Windows 用戶端以實現 ISCSI 連接
使用 Windows 2008 R2 或 Windows 2012 （R2） 更高版本。如果您有 Windows 2003 伺服器下載 Microsoft iSCSI Software Initiator：http://www.microsoft.com/en-us/download/details.aspx?id=18986
Step2 啟動 iSCSI 服務並將啟動類型設置為自動
執行services.msc
找到Microsoft iSCSi Initiator Service -> 內容 -> 啟動類型：自動，服務狀態啟動
點擊右鍵 -> 啟動
啟動完成顯示：執行中
Step3 查找虛擬機內iSCSI啟動器的IQN
執行 iscsicpl.exe
在設定，複製啟動器名稱
Step4 配置卷組
回到Prsim Element -> Storage -> Table -> +Volume Group
給其Name、在Storage給其硬碟、Access Settings勾選Enable External Client Access、在Client加入之前複製的IQN，之後Save
Step5 連接到發現的iSCSI Target並保留連接
回到iSCSI啟動器 -> 探索 -> 搜索目標入口 -> 輸入Nutanix Data Service IP
再到目標，可以觀察到"已經連線"
Step6 硬碟配置
輸入diskmgmt.msc
即可看到未初始化的硬碟，連線初始化與格式化硬碟，即完成配置
Lab: AHV直接附加卷組
Step 1 Prism Element -> Storage -> Table -> + Volume Group -> 給其名稱和儲存
Step2 將VG 附加在虛擬機上
點擊剛剛建立的VG -> Update -> + Attach to a VM
Step3 硬碟配置
輸入diskmgmt.msc
即可看到未配置未初始化的硬碟，請依照之前的步驟配置
結論 Volume Group ：
透過AHV直接附加卷組到VM的功能簡化了iSCSI的配置。
虛擬磁碟
虛擬磁碟是在儲存容器或磁碟區組中建立的，以便為虛擬機器提供儲存。當虛擬磁碟對應到虛擬機器時，它會顯示為 SCSI 裝置。
點擊VM -> Table -> 選取要看的虛擬機 -> VM Disks -> 即可看到SCSI裝置
虛擬硬碟效能分析
點擊I/O Metrics，即可看到平均IO延遲、讀寫資料區塊大小、資料類型是連續還是隨機
Prism Element -> Network
僅支持AHV，在網路可視化中能讓您更能了解網路配置
PE -> Network
點擊主機名城Host "NX01"可以看每台主機的網路配置
點擊網卡可以看流量
Prism Element -> Hardware
檢視硬體配置與狀態
PE -> Hardware -> Diagram
可以看配置的型號與視圖(硬碟/電源)，以本範例來說NX01-NX03硬碟配置是插滿的，NX04-NX05只插前面兩個插槽。
PE -> Hardware -> Table -> Host
可以查看每台的主機/CVM IP資訊與使用率等效能狀態
點擊想要查看的主機則會有更詳細的訊息
在Summary可以看到詳細的主機資訊
PE -> Hardware -> Table -> Disk
檢視實體硬碟使用量與效能資訊
Prism Element -> Analysis
Analysis dashboard （分析） 控制面板允許您創建可以動態監控各種性能度量的圖表。
Charts 圖表: 顯示定義的圖表集。選取圖表名稱旁邊的框以在中間窗格中運行該圖表。選取該框後不久，圖表監視器就會顯示在中間窗格中。取消選取此方塊以停止該監視器並將其從中間窗格中刪除。要編輯圖表定義，請按下名稱右側的鉛筆圖示。這將打開edit chart 視窗，該視窗與新圖表視窗相同，但標題不同。要刪除圖表，請按下右側的叉號圖示。
- New Metric Chart 新指標圖表: 允許您創建跟蹤一個或多個實體的單個量度的圖表。
- New Entity Chart 新建實體圖: 允許您創建追蹤單個實體的一個或多個指標的圖表。
Lab: 分析 Metric Chart
目標：創建一個分析圖表，查找出指定的兩台資料庫虛擬機XX-DB，YY-DB的儲存延遲狀態，時間為過去三小時內的某個時間點
PE -> Analysis -> New Metric Chart
Chart Title: 給其想要的名稱，這邊輸入為DB Storage-Latency
Metric: 找到Storage Controller Latency
Entity Type: 選Virtaul Machine
Entity: 找到要比較的兩台資料庫虛擬機XX-DB，YY-DB
之後點擊Save儲存
在最左邊的Chat欄位找到剛剛配置的DB-Storage-Latency打勾，其他之前配置的圖表不要勾，這樣中間的分析圖會比較簡潔
在上方Range勾選過去3 Hours，並拉動藍色的Bar找到指定的時間
即可以查看當時的效能資訊，0.68ms/26.2ms
Lab: 分析 Entity Chart
目標：分析某一個CRM-AP一個月的效能圖表，需要CPU使用率/CPU Ready Time/記憶體使用率/儲存IOPS/網路TX和RX，並匯出圖表資訊為CSV檔案
PE -> Analysis -> New Entity Chart
Chart Title: 給其想要的名稱，這邊輸入為CRM-AP_Chart
Entity Type: 選Virtaul Machine
Entity: CRM-AP
Metric: 拉需求圖表如下圖
之後點擊Save儲存
勾選左邊Charts剛剛建立的CRM-AP_Chart，在上方時間區間選擇1 Month，點擊圖表匯出
Export Chart Data(CSV)
性能數據可提供 3 個月內資料。
Prism Element -> Alerts and Events
您可以通過 Prism Element Web 控制台或命令行介面 （nCLI） 監控和配置 Nutanix 叢集中的實體。
Prism Element Web 控制台提供了多種機制來監控和配置叢集警報和事件。
Alerts Dashboard 允許您 查看和監控集群中的警報和事件活動。
- Alerts Summary View （警報摘要檢視） 顯示您以各種方式篩選的警報清單。您還可以深入查看警報的詳細資訊和解決措施。
- Events Summary View （事件摘要檢視） 顯示您以各種方式篩選的事件清單。您還可以深入查看事件的詳細資訊。
啟用警報后，一些潛在的高影響事件也會通過 Nutanix 客戶支援自動開Case。可能生成 Nutanix 支援案例的事件包括硬體問題，例如電源或磁碟故障;監控 Stargate 中斷或 Curator 掃描失敗等問題;以及數據處理問題，例如禁用壓縮或重複資料刪除。
默認情況下，Prism 將警報和事件保留 90 天，每小時數據保留一年。（預設情況下，某些DR事件僅保留7天)。
- Title 標題: 顯示警報的標題，按兩下標題可顯示該警報的詳細資訊頁面。
- Source Entity 來源實體: 顯示警示應用到的實體（例如叢集、主機或 VM 名稱）。
- Impact Type 影響類型，Availability, Capacity, Configuration, Performance, System Indicator可用性、容量、配置、性能、系統指示器。
- Severity嚴重級別: 顯示此情況的嚴重性級別。有三個級別：
- Critical 危急: 已檢測到可操作的危急情況，需要立即採取行動，叢集可能會停止運行，或者可能會遇到無法修復的問題。
- Warning 警告: 檢測到可操作的問題，需要用戶干預，如果不儘快解決這個問題，可能會出現更嚴重的問題。
- Informational (Info) 資訊: 檢測到可操作的小問題，並不影響叢集運行大都為建議配置的操作。
- Resolved 解決: 指示警報是否已解決。解決錯誤意味著您設置了錯誤已修復。（如果掃描情況異常再發生，則可能會返回警報再未來某個時間點。如果您不想收到以下通知再次出現該條件，關閉針對此情況的警報，必須配置Alert Policies警報政策。
- 欄位是空白表示警報未解決。
- Auto(date_time): 在指定時間自動解決。
- By user(date_time): 透過使用者在指定的時間手動解決。
- Acknowledged 確認: 指示是否已確認警報。承認 警報表示您認識到存在錯誤（不再提醒 this condition），但 alert 狀態保持不變。選項（空白、 auto 或 user）與 Resolved 相同。
PE -> Alerts -> Filters -> 勾選Critical/Warning，RESOLVED: No
點擊Title "VSS Snapshot Failed"
可以知道警報發生的初始時間/最後一次發生的時間、和一些細節、造成的原因、建議的解決方式
處理完成，確認無誤後，點擊Resolve, Acknowledge
本範例是更新NGT試試
點擊Title "Skipped replication Of Snapshot For IFPCI-DB"
本範例原因為主中心和異地端之間的網路頻寬不足
本警報有參考的KB，點擊View KB Article
會有超連結到Support Portal的KB，詳細說明此問題發生的可能原因以及解決方式
Lab: 找出告警了解後了解後並解決之
告警：The cluster is using password based ssh access for the cvm x.x.x.x.
PE -> Alerts -> 檢視Alerts，找到“The cluster is using password based ssh access for the cvm x.x.x.x.”
點擊Policy -> The cluster is using password based ssh access.
Update Policy -> Info: 不要打勾
點擊Resove和Acknowledge
Summary: 在叢集上啟用基於密碼的遠端登入。建議使用基於密鑰的 ssh 訪問而不是基於密碼的 ssh 訪問，以提高安全性。
本範例了解了這個安全性規則，並確保此告警不會再跳出來。
