Tracing

Observability for LLM Applications: Tracing, Tokens, and Feedback Loops

What to actually instrument in an LLM application beyond latency and error rate, and how to close the loop from production traffic to eval sets.