Solved: VM provisioning model does not show new C4A Machin... - Page 2

rohitg-brt · 11-11-2024 12:09 AM

When creating a batch job in GCP Batch, the VM provisioning model under resource specification does not list the C4A machine types.

We want to use this Arm based processor as it offers faster speed for our ML task.

Yiyu

Hello there,

So the UI is not showing up the C4A support for Batch yet, but we should have a way to work that around. Here is what you can do:

1. Using gcloud command to submit a Batch job like: gcloud batch jobs submit c4ajob --config job.json

c4ajob is the Batch job name
job.json is the job configuration json file

2. For the job.json file, here is a sample file:

{
  "taskGroups": [ 
    {
      "taskSpec": {
        "computeResource": {
          "cpuMilli": "2000",
          "memoryMib": "2000"
        },
        "runnables": [
          {
            "script": {
              "text": "sleep 1000"
            }
          }
        ],
      },
    }
  ],
  "allocationPolicy": {
    "instances": [
      {
        "policy": {
        "machineType": "c4a-standard-1",
        "bootDisk": {
          "type": "hyperdisk-balanced",
          "sizeGb": "10",
          "image": "projects/debian-cloud/global/images/debian-12-bookworm-arm64-v20241009"
        }
      }
      }
    ]
  },
  "labels": {
    "department": "finance",
    "env": "testing"
  },
  "logsPolicy": {
    "destination": "CLOUD_LOGGING"
  }
}

So the key part is the allocationPolicy settings to support c4a using hyperdisk.

View solution in original post

VM provisioning model does not show new C4A Machine Types (Axion Processor)