
Agentic Quality Engineering
- 123 installs
- 433 repo stars
- Updated August 4, 2026
- proffesor-for-testing/agentic-qe
When you need AI agents to plan, generate, execute, and iterate on quality engineering workflows—coverage, regression, and release gates—beyond one-off test prompts.
About
Agentic Quality Engineering from proffesor-for-testing/agentic-qe equips Claude Code to run autonomous QE workflows: strategize coverage, generate and execute tests, analyze failures, and iterate until release criteria pass—especially for SaaS, API, and agent products needing continuous verification.
- Agent-orchestrated test planning and execution
- Iterative failure triage and coverage expansion
- Regression loops tied to release readiness
- Works across SaaS, API, and agent-based stacks
- Scales QE beyond static CI scripts
Agentic Quality Engineering by the numbers
- 123 all-time installs (skills.sh)
- +5 installs in the week ending Aug 4, 2026 (Skillselion tracking)
- Ranked #938 of 2,153 Testing & QA skills by installs in the Skillselion catalog
- Data as of Aug 5, 2026 (Skillselion catalog sync)
npx skills add https://github.com/proffesor-for-testing/agentic-qe --skill agentic-quality-engineeringAdd your badge
Show developers this skill is listed on Skillselion. Paste this into your README.
| Installs | 123 |
|---|---|
| repo stars | ★ 433 |
| Last updated | August 4, 2026 |
| Repository | proffesor-for-testing/agentic-qe ↗ |
What it does
When you need AI agents to plan, generate, execute, and iterate on quality engineering workflows—coverage, regression, and release gates—beyond one-off test prompts.
Files
Agentic Quality Engineering
<default_to_action> When implementing agentic QE or coordinating agents: 1. SPAWN appropriate agent(s) for the task using Task tool with agent type 2. CONFIGURE agent coordination (hierarchical/mesh/sequential) 3. EXECUTE with PACTS principles: Proactive analysis, Autonomous operation, Collaborative feedback, Targeted risk focus, Structured governance (observability and explainability of agent behavior) 4. VALIDATE results through quality gates before deployment 5. LEARN from outcomes - store patterns in aqe/learning/* namespace
Quick Agent Selection:
- Test generation needed →
qe-test-generator - Coverage gaps →
qe-coverage-analyzer - Quality decision →
qe-quality-gate - Security scan →
qe-security-scanner - Performance test →
qe-performance-tester - Full pipeline →
qe-fleet-commander
Critical Success Factors:
- Agents amplify human expertise, not replace it
- Human-in-the-loop for critical decisions
- Measure: bugs caught, time saved, coverage improved
</default_to_action>
Quick Reference Card
When to Use
- Designing autonomous testing systems
- Scaling QE with intelligent agents
- Implementing multi-agent coordination
- Building CI/CD quality pipelines
PACTS Principles
| Principle | Agent Behavior | Human Role |
|---|---|---|
| Proactive | Analyze pre-merge, predict risk | Set guardrails |
| Autonomous | Execute tests, fix flaky tests | Review critical |
| Collaborative | Multi-agent coordination | Provide context |
| Targeted | Risk-based prioritization | Define risk areas |
| Structured | Governance, observability, explainable decisions (measure confidence, not trust) | Audit behavior, set policy |
19-Agent Fleet
| Category | Agents | Primary Use |
|---|---|---|
| Core Testing (5) | test-generator, test-executor, coverage-analyzer, quality-gate, quality-analyzer | Daily testing |
| Performance/Security (2) | performance-tester, security-scanner | Non-functional |
| Strategic (3) | requirements-validator, production-intelligence, fleet-commander | Planning |
| Advanced (4) | regression-risk-analyzer, test-data-architect, api-contract-validator, flaky-test-hunter | Specialized |
| Visual/Chaos (2) | visual-tester, chaos-engineer | Edge cases |
| Deployment (1) | deployment-readiness | Release |
| Analysis (1) | code-complexity | Maintainability |
Coordination Patterns
Hierarchical: fleet-commander → [generators] → [executors] → quality-gate
Mesh: test-gen ↔ coverage ↔ quality (peer decisions)
Sequential: risk-analyzer → test-gen → executor → coverage → gateSuccess Criteria
✅ 10x deployment frequency with same/better quality ✅ Coverage gaps detected in real-time ✅ Bugs caught pre-production ❌ Agents acting without human oversight on critical decisions ❌ Deploying all 19 agents at once (start with 1-2)
---
Core Concepts
QE Evolution
| Stage | Approach | Limitation |
|---|---|---|
| Traditional | Manual everything | Human bottleneck |
| Automation | Scripts + fixed scenarios | Needs orchestration |
| Agentic | AI agents + human judgment | Requires trust-building |
Core Premise: Agents amplify human expertise for 10x scale.
Key Capabilities
1. Intelligent Test Generation
// Agent analyzes code change, generates targeted tests
const tests = await qeTestGenerator.generate(prDiff);
// → Happy path, edge cases, error handling tests2. Pattern Detection - Scan logs, find anomalies, correlate errors
3. Adaptive Strategy - Adjust test focus based on risk signals
4. Root Cause Analysis - Link failures to code changes, suggest fixes
---
Agent Coordination
Memory Namespaces
aqe/test-plan/* - Test planning decisions
aqe/coverage/* - Coverage analysis results
aqe/quality/* - Quality metrics and gates
aqe/learning/* - Patterns and Q-values
aqe/coordination/* - Cross-agent stateMemory Operations (MCP Tools)
CRITICAL: Always use aqe memory store with persist: true for learnings.
1. Store data to persistent memory:
// Store test plan decisions (persisted to .agentic-qe/memory.db)
aqe memory store \
--key "aqe/test-plan/pr-123" \
--namespace "aqe/test-plan" \
--value '{...}' \
--json2. Retrieve prior learnings before task:
// Query patterns before starting test generation
const priorData = await aqe memory get --key "aqe/learning/patterns/test-generation/*" --namespace "aqe/learning" --json
// Use patterns to guide current task
if (priorData.success) {
console.log(`Loaded ${priorData.patterns.length} prior patterns`);
}3. Store coverage analysis results:
aqe memory store \
--key "aqe/coverage/auth-module" \
--namespace "aqe/coverage" \
--value '{...}' \
--jsonThree-Phase Memory Protocol
For coordinated multi-agent tasks, use the STATUS → PROGRESS → COMPLETE pattern:
// PHASE 1: STATUS - Task starting
aqe memory store \
--key "aqe/coordination/task-123/status" \
--namespace "aqe/coordination" \
--value '{...}' \
--json
// PHASE 2: PROGRESS - Intermediate updates
aqe memory store \
--key "aqe/coordination/task-123/progress" \
--namespace "aqe/coordination" \
--value '{...}' \
--json
// PHASE 3: COMPLETE - Task finished
aqe memory store \
--key "aqe/coordination/task-123/complete" \
--namespace "aqe/coordination" \
--value '{...}' \
--jsonBlackboard Events
| Event | Trigger | Subscribers |
|---|---|---|
test:generated | New tests created | executor, coverage |
coverage:gap | Gap detected | test-generator |
quality:decision | Gate evaluated | fleet-commander |
security:finding | Vulnerability found | quality-gate |
Example: PR Quality Pipeline
// 1. Risk analysis
const risks = await Task("Analyze PR", prDiff, "qe-regression-risk-analyzer");
// 2. Generate tests for risks
const tests = await Task("Generate tests", risks, "qe-test-generator");
// 3. Execute + analyze
const results = await Task("Run tests", tests, "qe-test-executor");
const coverage = await Task("Check coverage", results, "qe-coverage-analyzer");
// 4. Quality decision
const decision = await Task("Evaluate", {results, coverage}, "qe-quality-gate");
// → GO/NO-GO with rationale---
Implementation Phases
| Phase | Duration | Goal | Agent(s) |
|---|---|---|---|
| Experiment | Weeks 1-4 | Validate one use case | 1 agent |
| Integrate | Months 2-3 | CI/CD pipeline | 3-4 agents |
| Scale | Months 4-6 | Multiple use cases | 8+ agents |
| Evolve | Ongoing | Continuous learning | Full fleet |
Phase 1 Example
# Week 1: Deploy single agent
aqe agent spawn qe-test-generator
# Weeks 2-3: Generate tests for 10 PRs
# Track: bugs found, test quality, review time
# Week 4: Measure impact
aqe agent metrics qe-test-generator
# → Tests: 150, Bugs: 12, Time saved: 8h---
Limitations & Strengths
Agents Excel At
- Volume: Scan thousands of logs in seconds
- Patterns: Find correlations humans miss
- Tireless: 24/7 testing and monitoring
- Speed: Instant code change analysis
Agents Need Humans For
- Business context and priorities
- Ethical judgment and trade-offs
- Creative exploration ("what if" scenarios)
- Domain expertise (healthcare, finance, legal)
---
Best Practices
| Do | Don't |
|---|---|
| Start with one agent, one use case | Deploy all 18 at once |
| Build feedback loops early | Deploy and forget |
| Human reviews agent output | Auto-merge without review |
| Measure bugs caught, time saved | Track vanity metrics (test count) |
| Build trust gradually | Give full autonomy immediately |
Trust Progression
Month 1: Agent suggests → Human decides
Month 2: Agent acts → Human reviews after
Month 3: Agent autonomous on low-risk
Month 4: Agent handles critical with oversight---
Agent Coordination Hints
coordination:
topology: hierarchical
commander: qe-fleet-commander
memory_namespace: aqe/coordination
blackboard_topic: qe-fleet
preload_skills:
- agentic-quality-engineering # Always (this skill)
- risk-based-testing # For prioritization
- quality-metrics # For measurement
agent_assignments:
qe-test-generator: [api-testing-patterns, tdd-london-chicago]
qe-coverage-analyzer: [quality-metrics, risk-based-testing]
qe-security-scanner: [security-testing, risk-based-testing]
qe-performance-tester: [performance-testing]---
Related Skills
holistic-testing-pact- PACTS principles deep diverisk-based-testing- Prioritize agent focusquality-metrics- Measure agent effectivenessapi-testing-patterns,security-testing,performance-testing- Specialized testing
Resources
- Agent definitions:
.claude/agents/ - CLI:
aqe agent --help - Fleet status:
aqe fleet status
---
Success Metric: Deploy 10x more frequently with same or better quality through intelligent agent collaboration.
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "https://agentic-qe.dev/schemas/agentic-quality-engineering-output.json",
"title": "Agentic Quality Engineering Skill Output Schema",
"description": "Schema for agentic quality engineering output with fleet status, agent coordination, and PACTS principles validation.",
"type": "object",
"required": ["skillName", "version", "timestamp", "status", "trustTier", "output"],
"properties": {
"skillName": {
"type": "string",
"const": "agentic-quality-engineering",
"description": "Must be 'agentic-quality-engineering'"
},
"version": {
"type": "string",
"pattern": "^\\d+\\.\\d+\\.\\d+(-[a-zA-Z0-9]+)?$",
"description": "Semantic version of the skill"
},
"timestamp": {
"type": "string",
"format": "date-time",
"description": "ISO 8601 timestamp of output generation"
},
"status": {
"type": "string",
"enum": ["success", "partial", "failed", "skipped"],
"description": "Overall execution status"
},
"trustTier": {
"type": "integer",
"minimum": 0,
"maximum": 3,
"description": "Trust tier level (3 for full validation)"
},
"output": {
"type": "object",
"required": ["summary", "fleetStatus", "agentCoordination"],
"properties": {
"summary": {
"type": "string",
"minLength": 50,
"maxLength": 2000,
"description": "Human-readable summary of agentic QE assessment"
},
"fleetStatus": {
"$ref": "#/$defs/fleetStatus",
"description": "Current fleet status and health"
},
"agentCoordination": {
"$ref": "#/$defs/agentCoordination",
"description": "Agent coordination state and metrics"
},
"pactPrinciples": {
"$ref": "#/$defs/pactPrinciples",
"description": "PACTS principles assessment (Proactive, Autonomous, Collaborative, Targeted, Structured)"
},
"qualityScore": {
"$ref": "#/$defs/qualityScore",
"description": "Overall quality engineering score"
},
"findings": {
"type": "array",
"items": {
"$ref": "#/$defs/finding"
},
"maxItems": 100,
"description": "Quality engineering findings"
},
"recommendations": {
"type": "array",
"items": {
"$ref": "#/$defs/recommendation"
},
"maxItems": 50,
"description": "Recommendations for improvement"
},
"metrics": {
"$ref": "#/$defs/metrics",
"description": "Quantitative metrics"
},
"artifacts": {
"type": "array",
"items": {
"$ref": "#/$defs/artifact"
},
"maxItems": 20,
"description": "Generated artifacts"
}
}
},
"metadata": {
"$ref": "#/$defs/metadata"
},
"validation": {
"$ref": "#/$defs/validationResult"
},
"learning": {
"$ref": "#/$defs/learningData"
}
},
"$defs": {
"fleetStatus": {
"type": "object",
"required": ["totalAgents", "activeAgents", "topology"],
"properties": {
"totalAgents": {
"type": "integer",
"minimum": 0,
"maximum": 50,
"description": "Total number of agents in the fleet"
},
"activeAgents": {
"type": "integer",
"minimum": 0,
"description": "Number of currently active agents"
},
"idleAgents": {
"type": "integer",
"minimum": 0,
"description": "Number of idle agents"
},
"failedAgents": {
"type": "integer",
"minimum": 0,
"description": "Number of failed agents"
},
"topology": {
"type": "string",
"enum": ["hierarchical", "hierarchical-mesh", "mesh", "ring", "star", "hybrid"],
"description": "Fleet topology configuration"
},
"health": {
"type": "string",
"enum": ["healthy", "degraded", "critical", "unknown"],
"description": "Overall fleet health status"
},
"coordinatorId": {
"type": "string",
"description": "ID of the fleet coordinator agent"
},
"uptime": {
"type": "integer",
"minimum": 0,
"description": "Fleet uptime in seconds"
},
"lastHeartbeat": {
"type": "string",
"format": "date-time",
"description": "Last heartbeat timestamp"
},
"agents": {
"type": "array",
"items": {
"$ref": "#/$defs/agentInfo"
},
"description": "List of agent information"
}
}
},
"agentInfo": {
"type": "object",
"required": ["id", "type", "status"],
"properties": {
"id": {
"type": "string",
"pattern": "^qe-[a-z][a-z0-9-]*$",
"description": "Agent identifier"
},
"type": {
"type": "string",
"description": "Agent type/role"
},
"status": {
"type": "string",
"enum": ["active", "idle", "busy", "failed", "terminated"],
"description": "Agent status"
},
"domain": {
"type": "string",
"description": "Agent's domain"
},
"tasksCompleted": {
"type": "integer",
"minimum": 0,
"description": "Number of tasks completed"
},
"lastActivity": {
"type": "string",
"format": "date-time",
"description": "Last activity timestamp"
}
}
},
"agentCoordination": {
"type": "object",
"required": ["coordinationMode", "tasksDistributed"],
"properties": {
"coordinationMode": {
"type": "string",
"enum": ["centralized", "distributed", "hybrid", "autonomous"],
"description": "Coordination mode"
},
"tasksDistributed": {
"type": "integer",
"minimum": 0,
"description": "Total tasks distributed"
},
"tasksCompleted": {
"type": "integer",
"minimum": 0,
"description": "Tasks completed successfully"
},
"tasksFailed": {
"type": "integer",
"minimum": 0,
"description": "Tasks that failed"
},
"tasksPending": {
"type": "integer",
"minimum": 0,
"description": "Tasks pending execution"
},
"averageTaskDuration": {
"type": "number",
"minimum": 0,
"description": "Average task duration in milliseconds"
},
"communicationLatency": {
"type": "number",
"minimum": 0,
"description": "Average inter-agent communication latency in ms"
},
"conflictResolutions": {
"type": "integer",
"minimum": 0,
"description": "Number of coordination conflicts resolved"
},
"loadBalancing": {
"type": "object",
"properties": {
"algorithm": {
"type": "string",
"enum": ["round-robin", "least-loaded", "capability-based", "adaptive"]
},
"efficiency": {
"type": "number",
"minimum": 0,
"maximum": 1,
"description": "Load balancing efficiency score"
}
}
}
}
},
"pactPrinciples": {
"type": "object",
"required": ["proactive", "autonomous", "collaborative", "targeted"],
"properties": {
"proactive": {
"$ref": "#/$defs/pactDimension",
"description": "Proactive quality measures"
},
"autonomous": {
"$ref": "#/$defs/pactDimension",
"description": "Autonomous decision-making capability"
},
"collaborative": {
"$ref": "#/$defs/pactDimension",
"description": "Collaboration effectiveness"
},
"targeted": {
"$ref": "#/$defs/pactDimension",
"description": "Targeted testing approach"
},
"structured": {
"$ref": "#/$defs/pactDimension",
"description": "Structured governance, observability, and explainability of agent behavior (measure confidence, not trust)"
},
"overallScore": {
"type": "number",
"minimum": 0,
"maximum": 100,
"description": "Overall PACTS score"
}
}
},
"pactDimension": {
"type": "object",
"required": ["score"],
"properties": {
"score": {
"type": "number",
"minimum": 0,
"maximum": 100,
"description": "Dimension score (0-100)"
},
"grade": {
"type": "string",
"pattern": "^[A-F][+-]?$",
"description": "Letter grade"
},
"indicators": {
"type": "array",
"items": {
"type": "string"
},
"description": "Key indicators for this dimension"
},
"improvements": {
"type": "array",
"items": {
"type": "string"
},
"description": "Suggested improvements"
}
}
},
"qualityScore": {
"type": "object",
"required": ["value", "max"],
"properties": {
"value": {
"type": "number",
"minimum": 0,
"maximum": 100,
"description": "Quality score (0-100)"
},
"max": {
"type": "number",
"const": 100
},
"grade": {
"type": "string",
"pattern": "^[A-F][+-]?$",
"description": "Letter grade"
},
"trend": {
"type": "string",
"enum": ["improving", "stable", "declining", "unknown"]
},
"breakdown": {
"type": "object",
"properties": {
"testCoverage": {
"type": "number",
"minimum": 0,
"maximum": 100
},
"defectDensity": {
"type": "number",
"minimum": 0
},
"automationRate": {
"type": "number",
"minimum": 0,
"maximum": 100
},
"fleetEfficiency": {
"type": "number",
"minimum": 0,
"maximum": 100
}
}
}
}
},
"finding": {
"type": "object",
"required": ["id", "title", "severity", "category"],
"properties": {
"id": {
"type": "string",
"pattern": "^AQE-\\d{3,6}$",
"description": "Unique finding identifier"
},
"title": {
"type": "string",
"minLength": 10,
"maxLength": 200
},
"description": {
"type": "string",
"maxLength": 2000
},
"severity": {
"type": "string",
"enum": ["critical", "high", "medium", "low", "info"]
},
"category": {
"type": "string",
"enum": ["fleet", "coordination", "quality", "automation", "coverage", "performance"]
},
"affectedAgents": {
"type": "array",
"items": {
"type": "string"
}
},
"remediation": {
"type": "string",
"maxLength": 2000
},
"confidence": {
"type": "number",
"minimum": 0,
"maximum": 1
}
}
},
"recommendation": {
"type": "object",
"required": ["id", "title", "priority"],
"properties": {
"id": {
"type": "string",
"pattern": "^REC-\\d{3,6}$"
},
"title": {
"type": "string",
"minLength": 10,
"maxLength": 200
},
"description": {
"type": "string",
"maxLength": 2000
},
"priority": {
"type": "string",
"enum": ["critical", "high", "medium", "low"]
},
"effort": {
"type": "string",
"enum": ["trivial", "low", "medium", "high", "major"]
},
"impact": {
"type": "integer",
"minimum": 1,
"maximum": 10
},
"relatedFindings": {
"type": "array",
"items": {
"type": "string",
"pattern": "^AQE-\\d{3,6}$"
}
}
}
},
"metrics": {
"type": "object",
"properties": {
"total": {
"type": "integer",
"minimum": 0
},
"passed": {
"type": "integer",
"minimum": 0
},
"failed": {
"type": "integer",
"minimum": 0
},
"duration": {
"type": "integer",
"minimum": 0,
"description": "Duration in milliseconds"
},
"custom": {
"type": "object",
"additionalProperties": true
}
}
},
"artifact": {
"type": "object",
"required": ["type", "path"],
"properties": {
"type": {
"type": "string",
"enum": ["report", "data", "screenshot", "log", "config"]
},
"path": {
"type": "string",
"maxLength": 500
},
"format": {
"type": "string",
"enum": ["json", "html", "md", "txt", "png", "csv", "yaml"]
},
"description": {
"type": "string",
"maxLength": 500
}
}
},
"metadata": {
"type": "object",
"properties": {
"executionTimeMs": {
"type": "integer",
"minimum": 0,
"maximum": 600000
},
"toolsUsed": {
"type": "array",
"items": {
"type": "string"
}
},
"agentId": {
"type": "string"
},
"modelUsed": {
"type": "string"
},
"environment": {
"type": "string",
"enum": ["development", "staging", "production", "ci"]
}
}
},
"validationResult": {
"type": "object",
"properties": {
"schemaValid": {
"type": "boolean"
},
"contentValid": {
"type": "boolean"
},
"confidence": {
"type": "number",
"minimum": 0,
"maximum": 1
},
"warnings": {
"type": "array",
"items": {
"type": "string"
}
},
"errors": {
"type": "array",
"items": {
"type": "string"
}
}
}
},
"learningData": {
"type": "object",
"properties": {
"patternsDetected": {
"type": "array",
"items": {
"type": "string"
}
},
"reward": {
"type": "number",
"minimum": 0,
"maximum": 1
},
"feedbackLoop": {
"type": "object",
"properties": {
"previousRunId": {
"type": "string"
},
"improvement": {
"type": "number",
"minimum": -1,
"maximum": 1
}
}
}
}
}
}
}