If you are building with LLMs, creating high quality evals is one of the most impactful things you can do. Without evals, it can be very difficult and time intensive to understand how different prompts, and model versions might affect your use case.

In the words of OpenAI’s president Greg Brockman:

Greg Brockman Evals Quote

QuickstartGeneral Purpose Metrics