Monitoring management services

The management services in Virtuozzo Hybrid Infrastructure include the following:

  • vstorage-ui-keystone-admin provides user identity and authentication for internal services, as well as service discovery for internal compute services. The service runs on the management node.
  • vstorage-ui-keystone-public provides user identity and authentication for external services, as well as service discovery for external compute services. The service runs on the management node.
  • vstorage-ui-backend provides API for the management panel (admin and self-service) and command-line interface, as well as orchestrates all cluster management tasks. The service runs on the management node.
  • vstorage-ui-agent is a worker service that executes tasks from the backend service. The service runs on each cluster node.

To monitor the management services, go to the Monitoring > Dashboard screen, and then click Grafana dashboard. A separate browser tab will open with preconfigured Grafana dashboards, one of which is dedicated to the management services and is called Backend service status. To see a detailed description for each chart, click the i icon on its left corner.

The Backend task state chart shows the state of management tasks over time. Management tasks include all tasks related to the infrastructure management. You can see the full list of tasks in the Task name drop-down menu above the chart and sort the displayed tasks by selecting them. The state can be one of the following: pending, running, success, or failed.

The Backend services status and Backend services list charts show the list of the management services and their availability over time. Time periods when the services have not been available will be highlighted in red. In this case, you will need to look into the following logs:

  • For the keystone-admin service on the management node:

    # less /var/log/vstorage-ui-backend/uwsgi-keystone-admin.log
  • For the keystone-public service on the management node:

    # less /var/log/vstorage-ui-backend/uwsgi-keystone-public.log
  • For the backend service on the management node:

    # less /var/log/vstorage-ui-backend/messages.log
    # less /var/log/vstorage-ui-backend/celery*.log
  • For the agent service on the affected cluster node:

    # less /var/log/vstorage-ui-agent/*

Other charts on the dashboard show the rate of successful and failed requests for the keystone and backend services, as well as the 95th and 99th percentiles of response time, per 10-minute intervals. The most important charts here are those of error request rate and response time. If you see spikes on them, you need to check the status of the corresponding services.