Inconsistent Responses from PDF Bot Using text-bison-001

[Santhiya]

I have developed the question and answering system based on the PDF bot using the "model named text-bison-001".

llm = GoogleGenerativeAI(model="models/text-bison-001", google_api_key=os.environ['GOOGLE_API_KEY'], temperature=0)

I have encountered some specific problems, which I will list for your reference:

• When passing a question without a question mark, for example, 'What is Animal Farm', it returns different incorrect answers each time. With a question mark, it returns the correct answer but provides a partial response.

partial response snapshot:

Incorrect response snapshot:

• For the past week, it returned brief answers, and I did not face any issues with incorrect or partial responses. However, currently, it returns partial responses and, most of the time, inconsistent responses.

• Snapshot of responses from the previous week:

[jeerahalli · Accepted solution]

Hello,

Thank you for contacting the Google Cloud Community.

I have gone through your reported issue, however it seems like this is an issue observed specifically at your end. It would need more specific debugging and analysis. To ensure a faster resolution and dedicated support for your issue, I kindly request you to file a support ticket by clicking here[1]. Our support team will prioritize your request and provide you with the assistance you need.

For individual support issues, it is best to utilize the support ticketing system. We appreciate your cooperation!

[1]: https://cloud.google.com/support/docs/manage-cases#creating_cases