What observability measures
Token counts, latency, traces, evals, prompt versions, gateway spend. LangSmith, Langfuse, Helicone, and Datadog LLM Observability serve teams who ship LLM applications.
What it does not see
Microsoft 365 Copilot in a lawyer’s draft. JAX on a bank rec. Slack AI summarising a client channel. Consumer ChatGPT on a phone. Those events never pass your application tracer.
The word in the RFP
Regulated buyers search “AI observability” because that is the market vocabulary. The risk they are naming is missing proof in a customer-owned environment. That is Taigris.
Related