Conversation context in google.generativeai.chat

[rileygreen022]

Is there a way to have multiple chats happening at the same time with different contexts with google.generativeai.chat? i.e. running off the same API endpoint. 

[Poala_Tenorio]

Google's GenerativeAI Chat (the underlying technology behind Google's chat services) doesn't officially support parallel conversations with different contexts using a single API endpoint. The API is typically designed to handle one conversation context at a time per session.

However, developers can simulate multiple conversations by managing different sessions or instances of the API. Each instance or session would handle a separate conversation context. This requires careful management and tracking of each conversation's state separately.

Creating a system that orchestrates multiple conversations through different sessions would involve coordinating session management, context switching, and ensuring each conversation maintains its coherence without mixing contexts.

[jasonparker · Accepted solution]

If you maintain a history of the state for each chat, most definitely. You just need to pass in the history and other relevant for each call. In the docs, check out the "messages" parameter for the function call.