I have gone through the documentations https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/batch-prediction-gemini
the current documentation suggest the user inputs to be in format , how can i adda reference Id to this request so when results are generated i can related for which batch requests this was created for. one way to determine is reading the output in the same order as input was given.
there is also statement for the long running queries output are exported after 90 minutes. but its unclear for me how do i related my input request to the output request if i can't add a additional metadata .
{"request":{"contents": [{"role": "user", "parts": [{"text": "What is the relation between the following video and image samples?"}, {"fileData": {"fileUri": "gs://cloud-samples-data/generative-ai/video/animals.mp4", "mimeType": "video/mp4"}}, {"fileData": {"fileUri": "gs://cloud-samples-data/generative-ai/image/cricket.jpeg", "mimeType": "image/jpeg"}}]}]}}
I have tried adding additional fields to the json requests object but it never comes back in the response details.
one workaround i can think of is i can inject the request id in the prompt itself.
update:
my current solution is i am injection request id in the prompt and. Reading it back. this is very poor experience from google Gemini i didn't expected such workarounds i need to implement for the basic feature
LinkedIn
Twitter
