To view the storage cluster status
Click the cluster name at the bottom of the left menu. The status can be one of the following:
- All cluster components are active and operate normally.
- Not enough information about the cluster state (for example, because the cluster is inaccessible).
- Some of the cluster components are inactive or inaccessible. The cluster is trying to heal itself, data replication is scheduled or in progress.
- The cluster has too many inactive services and automatic replication is disabled. If the cluster enters this state, troubleshoot the nodes or contact the support team.
Use the following command:
vinfra cluster overview
For example, to view the status of the cluster
cluster1, take a look at this line from the command output:
+-------------------+-------------------------+ | Field | Value | +-------------------+-------------------------+ | ... | ... | | status | healthy | | ... | ... | +-------------------+-------------------------+
To view the storage cluster statistics
Go to the Monitoring > Dashboard screen:
- To view the storage cluster statistics in full screen, click Fullscreen mode.
- To exit the fullscreen mode, press Esc or click Exit fullscreen mode.
The default time interval for the charts is twelve hours. To zoom into a particular time interval, select the internal with the mouse; to reset zoom, double-click any chart.
Use the following command:
vstorage -c <cluster_name> top
For example, to view the general information about the cluster
cluster1, take a look at this section from the command output:
Cluster 'cluster1': healthy Space: [OK] allocatable 11.9TB of 57.3TB, free 13.0TB of 57.3TB MDS nodes: 3 of 3, epoch uptime: 13d 3h CS nodes: 32 of 32 (32 avail, 0 inactive, 0 offline) License: ACTIVE (expiration: 01/01/2100, capacity: 500TB, used: 21.2TB) Replication: 1 norm, 1 limit IO: read 26.2MB/s (1.9Kop/s), write 426MB/s (11Kops/s)
Overall status of the cluster:
- All chunk servers in the cluster are active.
- There is not enough information about the cluster state (for example, because the master MDS server was elected a while ago).
- Some of the chunk servers in the cluster are inactive.
- The cluster has too many inactive chunk servers; the automatic replication is disabled.
- One or more physical disks attached to cluster nodes are in pre-failure condition.
Amount of disk space in the cluster:
- Free physical disk space in the cluster.
- Amount of logical disk space available for storing data. Allocatable disk space is calculated on the basis of the current replication parameters and free disk space on chunk servers. It may also be limited by license.
Number of active MDS servers as compared to the total number of MDS servers configured for the cluster.
- Time elapsed since the MDS master server election.
Number of active chunk servers as compared to the total number of chunk servers configured for the cluster. In parentheses, you can see the additional information on these chunk servers:
- Active chunk servers that are currently up and running in the cluster.
- Inactive chunk servers that are temporarily unavailable. A chunk server is marked as inactive during its first 5 minutes of inactivity.
- Offline chunk servers that have been inactive for more than 5 minutes. A chunk server changes its state to offline after 5 minutes of inactivity. Once the state is changed to offline, the cluster starts replicating data to restore the chunks that were stored on the offline chunk server.
- Key number under which the license is registered on the Key Authentication server and license state.
- Replication settings. The normal number of chunk replicas and the limit after which a chunk gets blocked until recovered.
Disk I/O activity in the cluster:
- Speed of read and write I/O operations, in bytes per second
- Number of read and write I/O operations per second
To view more details about the storage cluster
Go to the Monitoring > Dashboard screen, and then click Grafana dashboard.
A separate browser tab will open with preconfigured Grafana dashboards where you can manage existing dashboards, create new ones, share them between users, configure alerting, etc. The dashboards use the Prometheus data source. Its metrics are stored for seven days. If you want to increase this retention period, you can configure it manually. For more information, refer to Grafana documentation.