Now liveThe Skillselion MCP - thousands of ranked skills, loaded into your agent mid-task. No install.Get it →
openai avatar

Test Triage

  • 21 installs
  • 4.9k repo stars
  • Updated July 14, 2026
  • openai/plugins

test-triage classifies macOS test failures from scoped Xcode or SwiftPM runs.

About

The test-triage skill narrows macOS test failures without treating every red test as a product bug. It detects whether xcodebuild test or swift test is appropriate, runs the smallest meaningful scope using targets or filters when provided, and classifies outcomes as build failure, assertion failure, crash, async flake, environment setup, or entitlement issues. Focused reruns avoid full-suite loops without new signal. Output reports the command, smallest failing scope, top failure category, likely cause, and next proof step. Guardrails separate compilation from execution failures, flag iOS-only assumptions on macOS, and mark probable flakes without overstating confidence. Detects Xcode versus SwiftPM harness automatically. Runs smallest failing target or filter first. Classifies build, assertion, crash, flake, and setup failures. Recommends focused reruns over full-suite loops. Summarizes command, scope, category, and next step. Clear failure category with command, scope, and next rerun step.

  • Detects Xcode versus SwiftPM harness automatically.
  • Runs smallest failing target or filter first.
  • Classifies build, assertion, crash, flake, and setup failures.
  • Recommends focused reruns over full-suite loops.
  • Summarizes command, scope, category, and next step.

Test Triage by the numbers

  • 21 all-time installs (skills.sh)
  • +1 installs in the week ending Jul 26, 2026 (Skillselion tracking)
  • Ranked #1,425 of 2,154 Testing & QA skills by installs in the Skillselion catalog
  • Data as of Aug 4, 2026 (Skillselion catalog sync)
At a glance

test-triage capabilities & compatibility

Capabilities
harness detection workflow · failure classification taxonomy · focused rerun guardrails
Use cases
testing · debugging
Platforms
macOS
IDEs
vscode
From the docs

What test-triage says it does

run the smallest meaningful test scope first
SKILL.md
Distinguish compilation failures from test execution failures
SKILL.md
npx skills add https://github.com/openai/plugins --skill test-triage

Add your badge

Show developers this skill is listed on Skillselion. Paste this into your README.

Listed on Skillselion
Installs21
repo stars4.9k
Last updatedJuly 14, 2026
Repositoryopenai/plugins

How do I triage failing macOS tests?

Triage macOS test failures across Xcode and SwiftPM with scoped runs and precise failure classification.

Who is it for?

macOS developers debugging Xcode or SwiftPM test suites.

Skip if: Skip for Linux-only packages without Apple test harnesses.

When should I use this skill?

User narrows test failures, explains assertions, or separates setup from regressions.

What you get

Clear failure category with command, scope, and next rerun step.

Files

SKILL.mdMarkdownGitHub ↗

Test Triage

Quick Start

Use this skill to run the smallest meaningful test scope first, classify failures precisely, and avoid treating every test failure like a product bug.

Workflow

1. Detect the test harness.

  • Use xcodebuild test for Xcode-based projects.
  • Use swift test for SwiftPM packages.

2. Narrow the scope.

  • If the user gave a target, product, or test filter, use it.
  • If not, prefer the smallest likely failing target before a full suite.

3. Classify the result.

  • Build failure
  • Assertion failure
  • Crash or signal
  • Async timing or flake
  • Environment or fixture setup issue
  • Missing entitlement or host app issue

4. Rerun intelligently.

  • Use focused reruns when a specific case fails.
  • Avoid burning time on full-suite reruns without new information.

5. Summarize clearly.

  • What command ran
  • Which tests failed
  • What kind of failure it was
  • The best next proof step or fix path

Guardrails

  • Distinguish compilation failures from test execution failures.
  • Call out when a test appears to assume iOS-only or simulator-only behavior.
  • Mark likely flakes as such instead of overstating confidence.

Output Expectations

Provide:

  • the command used
  • the smallest failing scope
  • the top failure category
  • a concise explanation of the likely cause
  • the next rerun or fix step

Related skills

FAQ

What does test-triage do?

test-triage classifies macOS test failures from scoped Xcode or SwiftPM runs.

When should I use test-triage?

User narrows test failures, explains assertions, or separates setup from regressions.

Is this skill safe to install?

Review the Security Audits panel on this page before installing in production.

This week in AI coding

Five minutes, every Monday - the tools, releases and tactics for developers.

unsubscribe anytime.