This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Announcements
This site is in read only until July 22 as we migrate to a new platform; refer to this community post for more details.
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Llama 3 Does Not Finish Answers

Posted on 07-18-2024 12:41 PM
CarlosWstar
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

I've got Llama 3 deployed to an endpoint and I'm sending the request below. For some reason as you can see, the answer is truncated. The model is consistently not completing answers and I'm sure what else I can do. Anyone have any ideas?

CarlosWstar_0-1721331604215.png

 

1 3 610
Topic Labels
Reply
3 REPLIES 3

Posted on --/--/---- --:-- AM
binoseven
Bronze 2
Bronze 2
Reply posted on --/--/---- --:-- AM

Tq

Reply

Posted on --/--/---- --:-- AM
CarlosWstar
Bronze 1
Bronze 1
In response to binoseven
Reply posted on --/--/---- --:-- AM

Any clue why this was marked as a solution? I'm not even sure what `Tq` means.

0 Likes
Reply

Posted on --/--/---- --:-- AM
CarlosWstar
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

Just want to add that this happens in the console as well.

CarlosWstar_0-1721335152767.png

 

0 Likes
Reply
Top Solution Authors
View all