This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Hey @mongoose, You may be hitting other individual validation limits on images/audio/video per the documented limits. So rather than the total token count throwing the error, its an individual token limit on a media type that is throwing the error. I agree that the error messages can be more useful, and I think that is coming in the future.
I tried 254k tokens (used the model to count the tokens) and it also doesn't respond properly. When the prompt's token count is reduced, the model starts responding.
Hey @mongoose, You may be hitting other individual validation limits on images/audio/video per the documented limits. So rather than the total token count throwing the error, its an individual token limit on a media type that is throwing the error. I agree that the error messages can be more useful, and I think that is coming in the future.
It looks like the model description in that UI is not exactly accurate. Until the future wide release, to get access to 1.5 Pro with a 2 million token context window join the Trusted Testers program in Vertex AI. The current public model info is documented here.
LinkedIn
Twitter
