LLM Evaluation

[Rajavelu]

Hi All,

How can we validated the playbook produced outputs? 

I created a playbook with tools in agent builder and I would like to test it and evaluate certain metrics like accuracy, relevance, response etc ...along with other metrics.

I know we can do human validations. Is there any other tool or service or best practices/Standard practice?

Thanks,