No-proxy telemetry
No-proxy LLM telemetry: track cost after each call
Opsmeter is production-ready without an SDK wrapper. Keep your provider call path unchanged, map provider usage fields, and send telemetry asynchronously with a short timeout.
Implementation model
- Call provider SDK/API and read usage metadata.
- Normalize payload with endpointTag, promptVersion, userId, and token fields.
- Send ingest asynchronously with timeout + swallow to protect request latency.
What is available now (No-SDK)
- Endpoint, promptVersion, and user/tenant attribution.
- Budget warning and exceeded workflows.
- Export, retention policy, and compare workflows.
What is roadmap (SDK-enabled runtime)
- Automatic wrappers for common frameworks.
- Runtime clamp/fallback/queue enforcement patterns.
- Policy contracts for machine-readable guardrail actions.