Using Claude 3.5 Sonnet and Claude 3 Opus with Startup Credits on Vertex AI

[ishanai]

Hello Google Cloud Community,

I'm seeking clarification regarding the use of Claude 3.5 Sonnet and Claude 3 Opus models through Vertex AI for our AI startup, specifically their eligibility with Google Cloud AI startup credits. We've received conflicting information and need a definitive answer.

Current understanding:

1. The Google Cloud Platform Services Summary lists these models as available foundation models in Vertex AI.
2. They are visible and seemingly available in the Vertex AI Model Garden.
3. The Terms of Service state that foundational models on Vertex AI are covered under Generative AI Services, which includes:
   • Vertex AI API for accessing generative AI foundation models
   • Vertex AI Model Garden for accessing various generative AI foundation models
4. Some Google Cloud representatives have confirmed we can use these models for our startup.

However, we've also heard conflicting information suggesting these models might not be eligible for use with startup cloud credits.

Questions:

1. Can we use Claude 3.5 Sonnet and Claude 3 Opus models through Vertex AI for our startup?
2. Are these models eligible for use with Google Cloud startup credits?
3. Are there any restrictions or special considerations we should be aware of?

This clarification is crucial for our development plans and resource allocation. Any official guidance would be greatly appreciated.

Thank you for your help!

[McMaco]

Hi ishanai,

Welcome to Google Cloud Community!

Yes, you can use both Claude 3.5 Sonnet and Claude 3 Opus models through Vertex AI for your AI startup! Here's some information to confirm:

Availability:

• Official Announcement: Google Cloud announced the availability of Anthropic's Claude 3.5 Sonnet and Claude 3 Opus models through Vertex AI on June 20, 2024.
  
  
• Startup Credits: can be used in Google Cloud Platform usage only, but Free Trial credits may be used for other services such as Maps API and Firebase. Based on the reduced scoping, It will be deducted first even if Free Trial credits may expire earlier.  

Considerations:

• Overview of partner models on Vertex AI: Since these models are third-party managed models that are available to use on Vertex AI. There might be limits on how many requests you can make per unit of time.
  
  
• Pricing: While Startup Credits might cover limited usage initially, be aware that using Claude models through Vertex AI incurs costs. It's recommended to review the pricing structure before extensive use. 

By leveraging Vertex AI and Startup Credits, your startup can potentially experiment with these powerful language models. Remember to review the pricing and usage limitations to ensure it aligns with your project's needs before using both Claude 3.5 Sonnet and Claude 3 Opus models.

Hope this helps.

[xyangcheng]

so if I understand correctly. A start can use claude models at their own cost.  cost is not covered by startup credit. 

[iabheejit]

Still don't understand it. It was a very confusing response. 

[DanielWienerr]

@McMaco you're going to need to give a better response than that