Monitoring management services

To monitor the management services, go to the Monitoring > Dashboard screen, and then click Grafana dashboard. A separate browser tab will open with preconfigured Grafana dashboards, three of which are dedicated to the management services: Backend service status, Backend service API status, and Backend task status. To see a detailed description for each chart, click the i icon on its left corner.

The Backend service status dashboard is used to monitor the following management services in Virtuozzo Hybrid Infrastructure:

  • vstorage-ui-keystone-admin provides user identity and authentication for internal services, as well as service discovery for internal compute services. The service runs on the management node.
  • vstorage-ui-keystone-public provides user identity and authentication for external services, as well as service discovery for external compute services. The service runs on the management node.
  • vstorage-ui-backend provides API for the management panel (admin and self-service) and command-line interface, as well as orchestrates all cluster management tasks. The service runs on the management node.
  • vstorage-ui-agent is a worker service that executes tasks from the backend service. The service runs on each cluster node.

The Primary node changes chart shows transition of the primary management role across cluster nodes over time. The Backend services status and Backend services list charts show the list of the management services and their availability over time. Time periods when the services have not been available will be highlighted in red. In this case, you will need to look into the following logs:

  • For the keystone-admin service on the management node:

    # less /var/log/vstorage-ui-backend/uwsgi-keystone-admin.log
  • For the keystone-public service on the management node:

    # less /var/log/vstorage-ui-backend/uwsgi-keystone-public.log
  • For the backend service on the management node:

    # less /var/log/vstorage-ui-backend/messages.log
    # less /var/log/vstorage-ui-backend/celery*.log
  • For the agent service on the affected cluster node:

    # less /var/log/vstorage-ui-agent/*

The Backend service API status dashboard shows the rate of successful and failed requests for the keystone and backend services, as well as the 95th, 99th, and 999th percentiles of response time, per 10-minute intervals. If you see spikes on the request response time charts, you need to check the status of the corresponding services. You can sort the displayed request details per hostname, service name, and service status.

The Backend task status dashboard shows the number and status of all management tasks over time, as well as the 95th and 99th percentiles of response time, per 10-minute intervals. Management tasks include all tasks related to the infrastructure management. You can see the full list of tasks in the Task name drop-down menu above the chart and sort the displayed tasks by selecting them. Additionally, you can sort the displayed information per task status and task type.