Generative AI & Datastore returning incomplete sentences & responses.

[SrikantaHexa]

How to prevent generative ai responses & datastore response from returning incomplete sentences/responses.

[xavidop]

Hi,

for that you just need to do some prompt engineering and design prompts
that allows Palm to not to do that!

Xavi

[jasonparker]

I found that I was able to help this problem by increasing the generator's token limit.

[SrikantaHexa]

Does increasing the token limit decreased the speed of response for you?

[jasonparker]

I haven't really noticed a change in speed, but it can lead to higher costs since the pricing is partly based on tokens generated.