missing data from cluster

[ambrogio]

Hello,

since some days , we are facing an issue with our gke console on google cloud platform.

We are receiving various errors when trying to retrieve any data about cluster, workloads, etc...

The messages received from the console are usually like:

The number of nodes is estimated by the number of Compute VM instances because the Kubernetes control plane did not respond, possibly due to a pending upgrade or missing IAM permissions on cluster page

Missing data from clusters   ... (unavailable)  on workloads page with an incomplete list or with bad informations

Failed to fetch the list of managed pods inside specific deployement pages

Sometimes we cannot display deployment charts and "Select the Cloud Monitoring account to see charts" 

Sometimes refreshing pages solve the errors, but it is not so frequent

As i remember this issue started when we passed our image from cos to cos_containerd and gke versions to 1.22. We tried to upgrade to 1.23 and then to our final version 1.24.6-gke.1500 but with no luck.

Usage of kubectl from an external vm inside the network is perfect and gives no problem.

Even every workload, service and load balancer is runnign without any problem.

How can i troubleshoot our cluster (expecially the master node) to understand where the problem is?

Thank you very much

[dionv · Accepted solution]

Hello Ambrogio,

Sorry for the late revert. Regarding the concern you are encountering "Missing Data from cluster", I have it raised to our Engineering team and they are working on it. As of the moment, there is no estimated time on when the issue will be fixed. You can always check this issue tracker I created to keep you updated.