Llm Obs Eval Pipeline
Implement an automated Datadog LLM evaluation pipeline that ingests production or staging traces, runs scorers, stores results, and surfaces regressions on each model or prompt change.
npx skills add https://github.com/datadog-labs/agent-skills --skill llm-obs-eval-pipeline| Installs | 217 |
|---|---|
| Repository | datadog-labs/agent-skills ↗ |
Related skills
Microsoft FoundryDeploy, invoke, evaluate, and troubleshoot Microsoft Foundry agents with Docker, ACR, and observability workflows.400k1.2kAzure AiWire Azure AI services—especially Content Safety in Java—into a solo builder’s backend when you need moderation, blocklists, and SDK patterns without digging through full Microsoft docs.397k1.2kAzure Hosted Copilot SdkDetect @github/copilot-sdk in a repo and scaffold, extend, or deploy Copilot-powered apps on Azure with BYOM support.369k1.2k
Lark EventRun long-lived Lark event consumers that stream IM, VC, and Minutes events as NDJSON for bots and agent subprocesses.244k
Setup Matt Pocock SkillsBootstrap AGENTS.md/CLAUDE.md and docs/agents/ with issue tracker, triage label vocabulary, and domain doc layout before using triage, PRD, TDD, and architecture skills.223k121k
Running Claude Code Via Litellm CopilotPoint Claude Code at a local LiteLLM proxy forwarding to GitHub Copilot Chat API for cheaper runs.220k61