Dataflow enable_google_cloud_profiler dataflow_service_options not working

[bochap-fs]

Hi,

We are trying to enabled the Google Cloud Profiler for Dataflow using dataflow_service_options -> enable_google_cloud_profiler. The dataflow job is created using the Golang dataflowlib package from the beam sdk (https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/runners/dataflow/dataflowlib). The enable_google_cloud_profiler was supplied as a string to DataflowServiceOptions in JobOptions. The profiler seems to be enabled on the job. But clicking on it and going into the profiler, we cannot find the service from the dropdown filter. And this was the error message "There were profiles collected for the specified time range, but none match the current filters." Has anyone experienced this before or know if it is something we might have done wrong

[lsolatorio]

Hi @bochap-fs,

Welcome and thank you for reaching out to our community.

You seem to be experiencing a rather unique situation, while I can't directly pin point its cause, you can refer to this document as reference and make sure your worker service account has the necessary permission to do the task.

You can also reach out to Dataflow support for better assistance.