This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Generative AI on Vertex AI locations

Posted on 07-24-2024 06:54 AM
BernardC
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Hi 

I am trying to fully understand where processing takes place using gemini models when a particular location is selected. I need my data to be resident in the UK and I want to use Gen AI, so I will choose the europe-west2 region which is in London.  This much is clear to me based on the link below

Generative AI on Vertex AI locations  |  Google Cloud

However, what is not clear to me is what the section in the screenshot below means:

BernardC_0-1721828645746.png

It reads :

Important: Machine learning (ML) processing for gemini-1.0-pro-001, gemini-1.0-pro-002, gemini-1.0-pro-vision-001, imagegeneration@005, and all available Anthropic Claude models occurs within the US when requests are made to regionally-available APIs in the US, or within the EU when requests are made to regionally-available APIs in Europe.

My questions are what is "Machine learning (ML) processing" mean in this context is it all requests made to Gemini or just a subset of them or something else? If in my AP call I specify "europe-west2" does this mean that my request will be or may be processed in a different European region. The UK is not within the EU

Thanks

0 1 1,720
Topic Labels
0 Likes
1 REPLY 1

Posted on --/--/---- --:-- AM
McMaco
Staff
Reply posted on --/--/---- --:-- AM

Hello BernardC,

Welcome to Google Cloud Community!

In the screenshot you provided, Machine learning (ML) processing specifically mentions certain models such as gemini-1.0-pro-001, gemini-1.0-pro-002, gemini-1.0-pro-vision-001, imagegeneration@005, and all available Anthropic Claude models. Here is the list included in the Anthropic Claude models: 

  • Claude 3.5 Sonnet
  • Claude 3 Opus
  • Claude 3 Haiku
  • Claude 3 Sonnet

Meaning all these models occur within the US when requests are made to regionally-available APIs in the US, or within the EU when requests are made to regionally-available APIs in Europe.

In your case, if in your API call you specified “europe-west2” and you are using a model that is not included in the listed above models, it means that your request will be processed in London, United Kingdom.

I hope the above information is helpful.