I want to stream the response from an ADK agent deployed using Vertex AI Agent Engine.
I’ve tried the following code (and some variations of it):
from datetime import datetime
from zoneinfo import ZoneInfo
# Assuming these imports are correct
# from adk_client import remote_app
# from adk.core.runner import StreamingMode
# 1. Set the timezone to Ecuador
ecuador_tz = ZoneInfo("America/Guayaquil")
# 2. Get the current time
ecuador_time = datetime.now(ecuador_tz)
# 3. Format it as a string
date_today_str = ecuador_time.strftime("%A, %Y-%m-%d %H:%M:%S")
print(f"Session date and time: {date_today_str}")
# Include the time in the initial state
init_state = {
"nombre_contacto_ws": "Rick",
"numero_de_telefono": "+593999163479",
"fecha_y_hora": date_today_str
}
user_id = "u_007"
remote_session = remote_app.create_session(user_id=user_id, state=init_state)
session_id = remote_session["id"]
print(f"Session created with ID: {session_id}")
print("\n--- Starting SSE event stream ---")
try:
for event in remote_app.stream_query(
user_id=user_id,
session_id=session_id,
message="Hola",
streaming_mode="sse" # I also tried StreamingMode.SSE here
):
print(event)
except Exception as e:
print(f"An error occurred during streaming: {e}")
print("--- Event stream ended ---")
I also tried using StreamingMode.SSE, but it didn’t work either. I’m unable to get a word-by-word streaming response (i.e., token-level streaming). Instead, the output comes in reasoning chunks, just like a normal stream_query call.
I’m starting to suspect that true streaming might not be supported when deploying an ADK agent via Vertex AI Agent Engine.
Can anyone confirm whether this is the case? Or even better, share an example of how to achieve word-by-word streaming if it is indeed possible?
Thanks in advance!
LinkedIn
Twitter
