Vertex AI Opus error code 500

[felxfelx]

How can I get Vertex Anthropic activated? I enabled it in model garden, but when I try a request it says that I have reached my quota. I can't access custom service email either unless since it is for individual use... 

[maricarp]

Hello @felxfelx,

Please be informed that Anthropic Claude 3 Opus is still in preview and its features are available “as is” and have limited support. As of the moment, Claude 3 Opus is available in us-east5 (Ohio) region. 

Moreover, the default quota limit as stated here in the documentation for Claude 3 Opus are the following:

1. Default quota limit - 15 QPM (queries per minute); 50,000 TPM (tokens per minute). TPM includes both input and output tokens.
2. Supported context length - 200,000 tokens

Should you want to increase any of your quotas for Generative AI on Vertex AI, you can use the Google Cloud console to request a quota increase.

On the other hand, for you to enable Anthropic Claude models and make a prompt request, your administrator must set the following:

1. Set required permissions
1. The user must be granted the Consumer Procurement Entitlement Manager Identity and Access Management (IAM) role. Any user who's been granted this role can enable an Anthropic Claude model in Model Garden.
2. The user must be granted the aiplatform.endpoints.predict permission. This permission is included in the Vertex AI User IAM role.
2. Set the organization policy - the organization policy to allow use of the following APIs:
1. Cloud Commerce Consumer Procurement API - cloudcommerceconsumerprocurement.googleapis.com
2. Commerce Agreement API - commerceagreement.googleapis.com

Please take note that if your organization sets an organization policy to restrict service usage, then an organization administrator must verify that cloudcommerceconsumerprocurement.googleapis.com and commerceagreement.googleapis.com are allowed by setting the organization policy.

Hope this helps.

[gautiert]

Hi @maricarp . Thanks for this information. Where can we find information about Claude 3 Opus region availability ? We would like to use it in Europe. Thanks.