Batch job will not start, stuck in "Queued" and "VM provisioning model: Pending..."
I have been using a job submission script for submitting jobs to Batch that has been working well. Today I ran...
Forum Posts
Will Google Cloud Batch persist the container file system between jobs?
When using GCP batch, I'd like to download an "index" file at the start of a job and cache it on the local con...
how to disable concurrency execution of batch job
I'm currently using a GCP workflow for batch job processing, set to run every 30 minutes. However, I'm facing ...
How to specify arguments to the entrypoint in GCP batch configuration file?
I can specify the entrypoint key with:```"entrypoint": ""``` But, how do I specify arguments (e.g "script.py")...
GCP Batch Jobs - queue/scheduled time
Not long ago (a couple of days) I encountered a problem: the tasks I started took a very long time to start (t...
GCP Batch together with GCP workflow
Hi, my use case is the following. I have three Batch jobs A,B,C to run. Each one of (A,B,C) has 1000 tasks. I ...
GCP Batch: job status not updating
My batch job shows "Running" in the Batch console:However, if I click on the job, the status is "Deleting":The...
getting GCP batch job task exit code in Python
I am attempting to retrieve the exit code from a GCP Batch job. I'm trying the following code:def get_task_exi...
Permission 'batch.states.report' denied
I'm submitting a google cloud batch job as service account with roles * Batch agent reporter* Batch job editor...
How can I figure out why a task failed on Google batch?
I have 4 tasks failed. Using the command:gcloud beta batch tasks list --job [JOB_NAME] --project [PROJECT_NAME...
Discard machine if task fails?
When using batch -- is there a way to discard a machine permanently if a task fails? E.g, tell Google Cloud ba...
Batch - structured logging
Hi,I have a long running R process in a container within a Batch Job.The R process is writing to stdOut and I'...
How can I get logs from the command line for a batch job?
I know how to open the logs in the logs explorer, but I'd like to use the CLI command `gcloud logging read`.Ho...
What does "error waiting for container" mean?
A lot of my batch jobs are failing with "error waiting for container: " -- what does this mean? I'm not sure h...
How can I view the ids of failed tasks?
When using Google Cloud batch, I see that several tasks have failed. How can I view the ids of those tasks, so...
View how many jobs are on a given VM when using Google Cloud batch?
Is there a way to see which jobs have been assigned to a VM? I want to guarantee that each of my VMs is runnin...
Batch - How to get secret manage
Hi，I saw the batch documentation, by setting secretVariables you can get the value on secret manage and map it...
Batch Feature Request: Machine Family Specifier
Batch allows the `machine-type` to be specified, which is very helpful and allows putting task on a specific m...
Viewing Labels added to a Batch Job
HiI am adding Labels to a Batch job as part of a Workflow. Is it possible to see the Labels on the Batch Servi...
Create instance using template living in another project
Is it possible to use launch a compute engine instance in one project, using an instance template defined in a...
Nextflow pipeline using google batch gets stuck in a process with malfunctioning bucket
I am running a nextflow pipeline on google cloud; the pipeline relies on a docker image, it works well locally...
Batch job on pre-existing vm
Hi,Is it possible to run a new job on a pre-existing VM? What I would like to do is to use configurations I've...
Batch UI does not load
Hi,First time posting here, please let me know if there is a more appropriate forum or board or location to po...
Batch - Scalability
Hi. Suppose I’m running jobs with ~1000 parallel tasks each. Roughly how many jobs can I run simultaneously wi...
GCP batch does not scale
I have ~20k existing completed/failed GCP batch jobs. For the GCP console, the Batch job list table takes ~5 m...
Why is the Batch console so slow?
I have been trying to shift my batch jobs from AWS Batch to GCP Batch.Why is the console so slow? It first tak...
Bath Jobs mounted disk 'read only file system'
I am running a Batch Job and mounting a disk into "mountPath: /mnt/disks/batchjob-disk". However, it says it i...
Example to show batch job retry in GCP Workflow
Hi,I have a Workflow that creates a batch job task that runs up a docker image to do image processing then exi...
Batch task scheduling inefficiency
Hi, I noticed an in-efficiency in Batch task scheduling. Suppose I have 14 tasks and each machine runs 4 tasks...
Batch jobs - Get task retry attempt
Is there any way to get a job task retry attempt by reading an environment variable?