LinkedIn
Twitter
Hi Experts,
I have search and conversation app (chatbot) which uses a datastore (unstructured PDF document). 80% of time when I ask a question it just gives an answer like below. Only in certain instances the answer is elaborated and meaningful.
Answer vague and not summarized
Expected answer
What am I doing wrong. How can I make it work to give the detailed summarization always?
Custom summarization prompt
--------------------------------
Given the conversation between a Human and a AI assistant and a list of sources, write a final answer for the AI assistant.
Follow these guidelines:
+ Answer the Human's query and make sure you mention all relevant details from the sources, using exactly the same words as the sources if possible.
+ The answer must be based only on the sources and not introduce any additional information.
+ All numbers, like price, date, time or phone numbers must appear exactly as
they are in the sources.
+ Give as comprehensive answer as possible given the sources. Include all
important details, and any caveats and conditions that apply.
+ Do not just say refer to link below. Always provide a detailed summary in first response itself.
+ The answer MUST be in English.
+ Don't try to make up an answer: If the answer cannot be found in the sources, you admit that you don't know and you answer NOT_ENOUGH_INFORMATION.
Begin! Let's work this out step by step to be sure we have the right answer.
Sources: $sources
$conversation
Human: $original-query
AI:
--------------------------------
Thanks,
John
