Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

How to evaluate Generative AI finetuned model

HI Team, 

I have successfuly fine tuned generative LLM with my own labeled training data with 7oo data points, i prepeared and upload training data as per schema: {input_text, output_text}, but now i am unable to see the evaluation. when i try to create evaluation i always get error that my jsonl file doesnot have prompt and ground Truth.

My question is when input schema is {input_text, output_text} then why would make a test jsonl data file witth prompt and ground Truth. 

at one place i read that : evaluation is not supported in generative LLM models.

please advise or guide. I really want to see my model performance.

0 6 2,267
6 REPLIES 6