SRE2.0: No LLM Metrics, No Future: Why SRE Must Grasp LLM Evaluation Now

recently, as opportunities to utilize LLM in services have increased, traditional infrastructure metrics have become insufficient for measuring service quality. We, as SREs, need to update our approach. In this article, we will introduce all the procedures ranging from selecting essential metrics for evaluating the reliability of LLM services to specific measurement and evaluation methods. We will also include a demo using the DeepEval library.