Hi all,
I am currently setting up Vertex AI using the @Google/genai SDK for Node.js library. I have multiple users from different locations with individual credentials and am getting stuck on how to initialize the model location and endpoints.
The call for setting up the config is: https://googleapis.github.io/js-genai/release_docs/interfaces/client.GoogleGenAIOptions.html
import {GoogleGenAI} from '@google/genai';
const ai = new GoogleGenAI({
vertexai: true,
project: 'PROJECT_ID',
location: 'PROJECT_LOCATION'
});
From what I have read, a GCP project is not tied to a specific location. But, models seem to only be available in certain regions. If I hard-code a location in like 'us-central1' would that allow users around the world to use Vertex? Would that cause issues if their project is in a different location or create latency problems?
And, if I do not hardcode, how can I guarantee the endpoint so that if they were to use provisioned throughput, they could place the correct order?
I have had a hard time understanding exactly how this works, especially since I am new to working with GCP. I would appreciate any insight people may have!
LinkedIn
Twitter
