Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

vertex ai Gemini 1.5 batch prediction with multi turn

Now I try to use batch prediction by using Gemini 1.5 and I want to use it as a multi-turn.

But I couldn't find any documents about it. Is it possible?

Solved Solved
0 2 495
1 ACCEPTED SOLUTION

Hi @parkjh688 ,

While Gemini 1.5 is incredibly useful for multi-turn conversations, using it for batch predictions with multi-turn conversations is not directly supported yet in standard Vertex AI workflows. 

With this, I suggest to file this as a feature request. Please note that I can't provide any details or timelines at this moment. However, you may keep an eye on the release notes for any latest updates or new features related to Vertex AI.

I hope the above information is helpful.

View solution in original post

2 REPLIES 2

Hi @parkjh688 ,

While Gemini 1.5 is incredibly useful for multi-turn conversations, using it for batch predictions with multi-turn conversations is not directly supported yet in standard Vertex AI workflows. 

With this, I suggest to file this as a feature request. Please note that I can't provide any details or timelines at this moment. However, you may keep an eye on the release notes for any latest updates or new features related to Vertex AI.

I hope the above information is helpful.

Thanks!