Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Error when connecting to llama3.1

While I try to connect to llama3.1 with langchain (VertexModelGardenLlama), I am getting this error 


"error": { "code": 400, "message": "Project `XXXXXXXX` is not allowed to use Publisher Model `projects/643892325147/locations/us-central1/publishers/meta/models/llama3-70b-instruct-maas`",
"status": "FAILED_PRECONDITION" }

The model that I am trying to connect to is  `
meta/llama3-70b-instruct-maas`

I notice that when I curl the command it works. It seems like it may be the langchain issue. If so, what is another way to connect to vertex ai llama using langchain?

 





1 2 595
2 REPLIES 2