colbymchenry/codegraph
2 skills2.3k installs129k starsGitHub
Install
npx skills add https://github.com/colbymchenry/codegraphSkills in this repo
1Agent EvalThe agent-eval skill benchmark CodeGraph retrieval quality on a real codebase by comparing agent behavior with vs without CodeGraph. Use when the user runs /agent-eval or asks to test, benchmark, audit, or validate a codegraph version (the local dev build or a published npm version) against a language's repo. # CodeGraph Quality Audit Measures how much CodeGraph helps an agent versus plain grep/read, for a chosen codegraph version on a chosen real-world repo. Drives the harness in `scripts/agent-eval/`. ## Prerequisites - `tmux` 3+, a logged-in `claude` CLI, `node`, `git` (macOS/Linux). - Run from the codegraph repo root. ## Workflow Copy this checklist: ``` - [ ] 1. Pick version (local or npm) - [ ] 2. Pick repo by size - [ ] 4. Pick harness (headless / tmux / both) - [ ] 5. Run audit.sh in the background - [ ] 6. Report results ``` **Step 1 - version.** Ask with `AskUserQuestion`: which codegraph version to test. Offer "Local dev build" and "Latest published"; the free-text "Other" lets the user type a specific version (e.g.1.4kinstalls2Add Langadd-lang is a CodeGraph skill that autonomously adds tree-sitter language support to the CodeGraph knowledge base—wiring grammars, extractors, tests, and documentation updates. After integration it benchmarks symbol extraction quality and retrieval value against 3 popular real-world repositories and compares agent performance with versus without CodeGraph context. Developers reach for add-lang when running /add-lang <language> or asking to support Lua, Elixir, Zig, OCaml, or other languages missing from CodeGraph. The workflow runs fully autonomously but follows a house rule to never commit, push, publish, or tag—leaving all changes for human review.952installs