This issue is no longer persisting. @bartonm I have tested your code and mine and the gemini api accepts up to 32k token in input at least as of this post in my region (North-America)

I am having the same issue using gemini-1.0-pro with the python vertexai sdk. The token limit for the input seems to be the limit of maxOuputTokens of 8192 tokens.