Monitor OpenShift Cluster and Application using Managed Service for Prometheus

[singh_raj08]

Hi,

We have OpenShift cluster running on GCE which hosts various Applications and Middleware components i.e. Elasticsearch, Kafka, keyCloak, Micro Services (Java and Python based) and Camunda.

We are exploring GCP Managed Service for Prometheus as one stop monitoring solution for infra, Middleware and Application metrics . As GCP natively supports Application Exporters for Elastic Search and Kafka. 

I would like to understand if we can use these application exporters in the OpenShift Cluster after enabling Managed collection for non-GKE Kubernetes environment.

Documentation says below as part of  Prerequisites for Elasticsearch and Kafka Application exporters : 

• Your cluster must be running Google Kubernetes Engine version 1.21.4-gke.300 or later.

Exporter References :

https://cloud.google.com/stackdriver/docs/managed-prometheus/exporters/kafka

https://cloud.google.com/stackdriver/docs/managed-prometheus/exporters/elasticsearch

Thanks,

Raj

[RonEtch]

Hi @singh_raj08 

Welcome to Google Cloud Community!

Base on the guide you followed for Application exporters, the prerequisites of Google Kubernetes Engine version 1.21.4-gke.300 or later is particularly for Google hosted kubernetes nodes.

I think you can follow this guide for self-deployed collection for Google Managed Prometheus since you will deploy it to a non-GKE cluster. For best practice, you may also want to have your cluster to run kubernetes version 1.21.4 and up.

Using the same link, you may want to check also about collecting metrics instances via Ops Agent since all your nodes are running in GCE

I hope this information is helpful.

If you need further assistance, you can always file a ticket on our support team.

[singh_raj08]

Thanks for responding @RonEtch .

Based on the above response I think self deployed collection approach would be more viable solution considering the non GKE cluster and GCE infra setup.

For all application exporters that comes out natively with managed collection will not work with self deployed collection and I would need to follow exporters source repository installation guide for Kafka and Elasticsearch :

https://cloud.google.com/stackdriver/docs/managed-prometheus/exporters/kafka. 

Please confirm if this is the correct understanding. 

Thanks