Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Transfer files into Google Batch VM at runtime?

How can I transfer files into a Google Cloud Batch VM at runtime, similar to how we used the '--inputs-from-file' flag in 'gcloud beta lifesciences pipelines run'? I'm transitioning from Lifesciences, which is in the deprecation process, to Google Cloud Batch.

Additionally, I can successfully create Batch Jobs, that spin up the container I need for my data processing, but the jobs always fail because I cannot find a way to supply the workflow file required for the runner in the container.

1 1 407
1 REPLY 1

At the moment, Batch does not have a flag for '--inputs-from-file. For the time being, we advise uploading the files/inputs to a Google Cloud Storage bucket and reference the bucket as a volume in the Batch job spec.