Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Cloud Scheduler Job doesn't have enough permissions to run Dataflow Pipeline

Hi there,

 

I created a Dataflow Pipeline, which works fine when I run it manually. And I see this error when Cloud Scheduler tries to invoke my pipeline. 

 

 

{
  "insertId": "ldo6vcg1s777l3",
  "jsonPayload": {
    "status": "PERMISSION_DENIED",
    "url": "https://datapipelines.googleapis.com/v1/projects/analytics-400818/locations/us-east1/pipelines/imaging-usage-daily-service-account:run",
    "@type": "type.googleapis.com/google.cloud.scheduler.logging.AttemptFinished",
    "targetType": "HTTP",
    "jobName": "projects/analytics-400818/locations/us-east1/jobs/datapipelines-imaging-usage-daily-service-account"
  },
  "httpRequest": {
    "status": 403
  },
  "resource": {
    "type": "cloud_scheduler_job",
    "labels": {
      "job_id": "datapipelines-imaging-usage-daily-service-account",
      "project_id": "analytics-400818",
      "location": "us-east1"
    }
  },
  "timestamp": "2024-01-04T09:00:00.215741857Z",
  "severity": "ERROR",
  "logName": "projects/analytics-400818/logs/cloudscheduler.googleapis.com%2Fexecutions",
  "receiveTimestamp": "2024-01-04T09:00:00.215741857Z"
}​

 

 

Please send me information on what roles I need to provide to a service account that runs my Dataflow Pipeline using Cloud Scheduler.
 
Thank you so much for your attention
0 3 665
3 REPLIES 3