Blacksmith
Let your agent inspect Blacksmith CI runs, explain failures, and surface flaky tests while you stabilize releases.
Overview
Blacksmith is a MCP server for the Ship phase that lets AI agents query Blacksmith CI runs, analyze test failures, and detect flaky tests.
What is this MCP server?
- Query Blacksmith CI runs and drill into test failures from the agent
- Flaky-test detection surfaced for triage conversations
- npm blacksmith-mcp (v0.1.1) stdio transport
- BLACKSMITH_ORG required; session cookie can auto-extract from Chrome when unset
- Server version 0.1.1
- Package: blacksmith-mcp on npm
- Transport: stdio
Community signal: 2 GitHub stars.
What problem does it solve?
Solo builders waste release time copying CI logs into chat because Blacksmith run context is locked in the web UI.
Who is it for?
Small teams on Blacksmith CI who want agent-assisted triage during ship/testing without building a custom CI API client.
Skip if: Projects on GitHub Actions only, other CI vendors, or teams that forbid browser session cookies for automation.
What do I get? / Deliverables
After you wire blacksmith-mcp with org and session auth, your agent can answer run-status and failure questions directly from Blacksmith CI data.
- Agent-queryable Blacksmith run and failure context
- Faster flaky-test identification in chat-driven workflows
- Reduced manual copy-paste from Blacksmith CI UI during ship
Recommended MCP Servers
Journey fit
Shipping safely depends on understanding what CI actually reported, not re-reading log dumps by hand. Testing subphase covers post-merge diagnosis—runs, failures, and flake signals—where an MCP bridge saves solo builders hours per incident.
How it compares
CI observability MCP hook, not a test authoring or security audit skill.
Common Questions / FAQ
Who is Blacksmith MCP for?
Developers and solo founders already using Blacksmith CI who want Claude or Cursor to query runs and failures over MCP.
When should I use Blacksmith MCP?
Use it in ship/testing when builds fail or flakes spike and you need fast, conversational access to Blacksmith run details.
How do I add Blacksmith MCP to my agent?
Install blacksmith-mcp from npm, set BLACKSMITH_ORG, provide BLACKSMITH_SESSION_COOKIE or rely on Chrome auto-extraction, and add the stdio server in your MCP config.