This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

gemini-1.5-pro-001 is not 2M context window. Is it fake?

Posted on 06-24-2024 07:06 AM
Yuwoe
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Yuwoe_0-1719237616790.png

Yuwoe_2-1719237843401.png

 

Current Token: 1,576,564 tokens

Yuwoe_1-1719237741460.png

I use this file for testing, is the 2M context window in vertex-ai is fake?

drive.google.com/file/d/1MNyzZu8Q8dlMV6TZQvPqXkittKoAIwiY/view?usp=sharing

 

Solved Solved
1 5 5,120
Jump to Solution
1 ACCEPTED SOLUTION

Posted on --/--/---- --:-- AM
AndrewB
Community Manager
Community Manager
In response to mongoose
Reply posted on --/--/---- --:-- AM

Hey @mongoose, You may be hitting other individual validation limits on images/audio/video per the documented limits. So rather than the total token count throwing the error, its an individual token limit on a media type that is throwing the error. I agree that the error messages can be more useful, and I think that is coming in the future.

View solution in original post

Jump to Solution
5 REPLIES 5