chat-bison model not able to answer in closed context.

[Pratik1223]

I am using `chat-bison` model for chat-bot to answer question based on retrieved documents.  However, it answers questions from its own knowledge without caring about the context.

Here is a small experiment, I tried.

Example 2
d=[{'context': 'Please answer the user question based on only the CONTEXT provided. Do not answer of your own. CONTEXT: Sachin Tendulkar is a cricketer. He was born is 1980.', 'messages': [{'author': 'user', 'content': 'When was Sachin Tendulkar born?'}]}]

Answer by chat-bison model
Sachin Ramesh Tendulkar was born on April 24, 1973 in Mumbai, India. He is a former international cricketer who served as captain of the Indian national team. He is widely regarded as one of the greatest batsmen in the history of cricket.

Also, what are the values of `author` which depicts if its `user`, `bot`, `system`?

@mchrestkha1 

[Expertopinionsa]

Hi, 

the chat bison does not always give you accurate answers to understanding the context, so you can try to prepend the conversation history, including the user question and previous model responses, to the context before making an inference. This helped me a lot, and I was advised to do so by one of the reps at Triotech Systems.  And for the values of the author field, they typically indicate the source of a particular message in the conversation. I hope it is clear or you can take help from some expert!

[Pratik1223]

I guess, the limitation ( Closed context) related to chat-bison is a known issue with this model.

[Expertopinionsa]

Sorryyy.. for responding so late.. But yeah you got it! You're absolutely right about chat-bison not quite nailing down the whole context thing. It's a known hiccup with the model, but don't worry, there are ways to work around it. One trick is to tack on the conversation history before making any big inferences. That helps the model get a better grip on what's going on. If you've got any more questions or need a hand with something else, don't hesitate to give me a shout at Triotech Systems! I'm here to help.

[stars]

I am having this exact problem and it is driving me mad! Both chat-bison and text-bison keep making up their own data and ignoring my instructions about only using provided context.

[AviAIML]

Not sure if there is a more recent update to closed list responses and not providing it's own knowledge and throwing off the responses. Like a Shout at AI to be within it's boundries.