Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Internal error (code 13) when tuning a model in Vertex AI

When processing a model tuning in Vertex AI, during the pipeline creation, i recieved an Internal error message.:

INFO:google.cloud.aiplatform.pipeline_jobs:PipelineJob projects/xxxxxxxxx/locations/xxxxx-xxxxx/pipelineJobs/tune-large-model-xxxxxxxxxxx current state:
PipelineState.PIPELINE_STATE_PENDING
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
<ipython-input-5-591a9a561b04> in <cell line: 4>()
      2 vertexai.init(project="xxxxxxxxx", location="us-central1")
      3 model = TextGenerationModel.from_pretrained("text-bison@001")
----> 4 model.tune_model(
      5     training_data=training_data,
      6     train_steps=100,

3 frames
/usr/local/lib/python3.10/dist-packages/google/cloud/aiplatform/pipeline_jobs.py in _block_until_complete(self)
    500         # JOB_STATE_FAILED or JOB_STATE_CANCELLED.
    501         if self._gca_resource.state in _PIPELINE_ERROR_STATES:
--> 502             raise RuntimeError("Job failed with:\n%s" % self._gca_resource.error)
    503         else:
    504             _LOGGER.log_action_completed_against_resource("run", "completed", self)

RuntimeError: Job failed with:
code: 13
message: "Internal error encountered. Please try again"

The error doesn't show more details, so i can't figure out what's wrong, any ideas about what is wrong?

1 1 2,566
1 REPLY 1