Adding mount_options when mounting a GCS bucket in Batch
Hi there,We are trying to mount a GCS bucket, but would like to add gcsfuse parameters: # Jobs can be divided ...
Forum Posts
Small subset of Batch tasks fail when loading docker image from artifact registry
Hi all,I ran a job with 200+ tasks using a docker container runnable hosted on GCP's artifact registry. The jo...
Batch - Tasks fail without logs when mounting GCS bucket without correct permission.
Hi all,Could someone clarify exactly the permissions required for the batch job service account to have on a b...
Batch - Batch runs a custom image and loses dot-separated environment variables
Hi,allIn the process of using Batch, I use dot-separated keys as environment variables.This works on a certain...
Docker command failing in Batch Service
Hi,Trying to use the new Batch service from a Workflow to launch the following docker:https://hub.docker.com/r...
Batch --- Setting cpu and memory does not take effect
Hi, allIn the process of using Batch, I found that if I configure the instance template, and then set the memo...
Batch - Add version option to "installGpuDrivers" Flag
Feature RequestIn a batch job specification 'the installGpuDrivers' Boolean flag can be added to initiate a sc...
Batch - How to query detailed batch failure reasons
Hi，I submitted the Batch task execution failed, but I can’t check the specific failure reason in events or log...
Batch: TaskEnvironments Array has a max length of 200 items
The TaskEnvironments array is the best way to specify task specific input when launching batch jobs. But this ...
Batch Job Max Parallel Tasks
The maximum number of parallel tasks for a job is 1k. https://cloud.google.com/batch/quotasI'm sure there are ...
Batch-Status is always QUEUE
I submitted the Batch job at 18:14 on June 5, 2023, but the job is still in the QUEUE state until now at 10:07...
Batch: Managing Instance Count and Tasks per Instance
Is there a limit on the number of tasks that can be running on a single VM associated with a batch job? Is it ...
Batch - how to choose machine type?
Hi,I'm a little confused about how select InstancePolicy.machine_type when creating jobs through Batch.Let's s...
What happens when a batch task is preempted on a spot machine?
If the task is still running when the machine is preempted, will this task be scheduled to run again later?
vpc -- Batch accesses GKE through k8s service name
I need to access the POD in GKE through the k8s service name on Batch.Can I access it by opening the VPC betwe...
gcsfuse mount without -implicit-dirs in Batch
We are mounting a Bucket to our Batch Tasks and passing in gcsfuse mount options.When we look at the GCP Logs,...
Batch - Network 403 forbidden
Hi，I have discovered another issue with GCP Batch. I have enabled access to the shared vpc for the Batch servi...
Batch - How to access configMap in GKE
Hi, I want to access the ConfigMap in my GKE cluster through Batch, but I can't find the relevant API in the G...
Batch job stuck in "Deleting" Status
This is still appearing as of today (04/30/2023) on the batch job list.There is no active VM on Compute Engin...
Batch - Understanding task_id string
I am viewing logs for a batch job with 10 tasks. I have the following query:```my-job-uuid logName="projects/m...
Google Batch instance group preemption or timeout
We've started using google batch to test some ETL processes. 19 hours in it appeared to be shut down automatic...
Batch - Issues failed to start
When I submitted the GCP Batch task, the batch execution failed and the following log was displayed in the Eve...
Failing python job without logs
Hello! I am trying to run a job with a task that 1. Installs pyenv and python with specific version2.Installs ...
Batch Job typically takes 3-4 minutes to complete, yesterday it took nearly 3 hours
I've ran several hundred Batch Jobs and this scenario has occurred a small handful of times. My code has errat...
Google Batch Job immediately fails after Docker image is downloaded
Hello,I have a batch job that was triggered just fine until 2 weeks ago. Neither job definition nor Docker ima...
Google Batch Job - T2A (ARM) Docker Image help
I'm using Google Batch to create a job which makes a "t2a-standard-4" machine type. However, I can't for the l...
Batch Job + Composer (Airflow) + Python
Hi all,I'm trying to set up an environment for the Cloud Composer. The goal is to have airflow tasks start bat...
Advanced Scheduling for Batch Jobs
Any info on if / when more advanced scheduling options might be made available?I am particularly interested in...
Batch: some jobs fail with no logs or status
Hi all,I have a Batch that normally succeeds but sometimes it fails.When it fails there are no logs and also n...
Batch: Defining ComputeResource
Hello,We're trying to set up GCP batch processing for jobs that require large amounts of RAM.The problem is th...