LLM telemetry reference

This page describes what data is provided by LLM observability and how it is used.

Span dataset schema

Spans are ingested to the Tracing/LLM Span dataset.

The LLM Span dataset incorporates additional fields over the Tracing/Span dataset.

LLM Span dataset fieldUnderlying OpenTelemetry field from which it is derived
llm_span_typeAttributes traceloop.span.kind and llm.request.type
request_modelAttribute llm.request.model
response_modelAttribute llm.response.model

The llm_span_type field provides an intuitive categorization of the LLM span. Depending on your application, you may see a mix among the following LLM span types:

  • agent
  • chat
  • tool
  • workflow
  • task
  • embeddings
  • completion
  • rerank

For more information about other fields, correlation tags, and other OpenTelemetry span related datasets, read our APM reference documentation

LLM metrics

The following metrics are derived from spans and are available in the Metrics Explorer, and can be used to create and share dashboards and create monitors and alerts:

  • gen_ai_span_call_count
  • gen_ai_span_error_count
  • gen_ai_span_duration
  • gen_ai_span_duration_lg

Metric dimensions (tags):

  • environment
  • service_name
  • service_namespace
  • service_version
  • llm_span_type
  • is_llm_request
  • provider
  • request_model
  • response_model
  • status_code
  • status_message