Dear All,
I'm quite new to DataFlow, I've build a job to read data from SQL Server and write into BigQuery. When I created the job and run it I could query the data in BigQuery, but when importing the job as pipeline and set to run daily at a specific time I get the following error:
jsonPayload: {
@type: "type.googleapis.com/google.cloud.scheduler.logging.AttemptFinished"
jobName: "projects/myproject/locations/southamerica-east1/jobs/datapipelines-primaviacargaerp"
status: "INVALID_ARGUMENT"
targetType: "HTTP"
}
logName: "projects/myproject/logs/cloudscheduler.googleapis.com%2Fexecutions"
receiveTimestamp: "2023-08-16T01:29:00.603723407Z"
resource: {2}
severity: "ERROR"
timestamp: "2023-08-16T01:29:00.603723407Z"
Just for testing, in the cloud scheduler I've taken out the ":run" from the URL, so the status became "not found" instead of "invalid argument". I really don't know what to do to have it scheduled and run every day.
LinkedIn
Twitter
