Memory and CPU usage of managed service for apache kafka

[RuiSMagalhaes]

Hi,

We are running a GCP Managed Kafka cluster in region europe-west2.

The cluster is active and processing traffic — we can see metrics such as `Bytes_in_count`and `Bytes_out_count` working correctly.

However, CPU and memory utilization metrics such as `managedkafka.googleapis.com/cpu/usage` and `.../memory/usage` are not available in Metrics Explorer.

Only `cpu.limit` and `memory.limit` are exposed.

I can see dashboards with cpu and memory usage at 0:

Is there anything we need to enable to receive those metrics ?
Is this expected or is this a possible issue in metric export ?

Thanks!

[reinc]

Hi @RuiSMagalhaes, 

Welcome to Google Cloud Community! 

Here are some workaround that may help along with relevant documentation:

1. Check Service Account Permissions
Managed services usually operate with a Google-managed service account that has the necessary permissions to write metrics.

• The service agent for Managed Kafka typically has a role like roles/managedkafka.serviceAgent. 
• You can find service agents in IAM by enabling "Include Google-provided role grants". The service agent will be in the format service-<PROJECT_NUMBER>@gcp-sa-managedkafka.iam.gserviceaccount.com.
  

2. Check GCP Status Dashboard

• Go to the Google Cloud Status Dashboard, there might be regional issues affecting specific services or Cloud Monitoring.

Check for any ongoing incidents related to:

• Cloud Monitoring
• Managed Service for Apache Kafka
• Specifically in the europe-west2 region.

If Metrics Remain Unavailable/Zero for an active cluster, please reach out to our Google Cloud Support.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.