How we evaluate AI models and LLMs for GitHub Copilot

We share some of the GitHub Copilot team’s experience evaluating AI models, with a focus on our offline evaluations—the tests we run before making any change to our production environment.