This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Llama 3 Does Not Finish Answers

Posted on 07-18-2024 12:41 PM
CarlosWstar
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

I've got Llama 3 deployed to an endpoint and I'm sending the request below. For some reason as you can see, the answer is truncated. The model is consistently not completing answers and I'm sure what else I can do. Anyone have any ideas?

CarlosWstar_0-1721331604215.png

 

1 3 513
Topic Labels
3 REPLIES 3

Posted on --/--/---- --:-- AM
binoseven
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Tq

Posted on --/--/---- --:-- AM
CarlosWstar
Bronze 1
Bronze 1
In response to binoseven
Reply posted on --/--/---- --:-- AM

Any clue why this was marked as a solution? I'm not even sure what `Tq` means.

0 Likes

Posted on --/--/---- --:-- AM
CarlosWstar
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

Just want to add that this happens in the console as well.

CarlosWstar_0-1721335152767.png

 

0 Likes