---
title: Backtesting Frameworks Skill for Claude Code
canonical: https://skillselion.com/skills/wshobson/agents/backtesting-frameworks
content_type: text/markdown
description: "Backtesting Frameworks is a skill for building robust, production-grade backtesting systems that avoid common pitfalls."
---

# Backtesting Frameworks Skill

Title: Backtesting Frameworks Skill for Claude Code

> Backtesting Frameworks is a skill for building robust, production-grade backtesting systems that avoid common pitfalls.

Canonical: https://skillselion.com/skills/wshobson/agents/backtesting-frameworks

Backtesting Frameworks is a skill for building robust, production-grade backtesting systems that avoid common pitfalls.

A framework for building production-grade backtesting systems for trading strategies. Covers common pitfalls including look-ahead bias, survivorship bias, overfitting, and transaction costs. Includes walk-forward analysis and out-of-sample testing patterns.

## Key facts

- Installs: 17,912
- GitHub stars: 42,632
- Author: wshobson
- Repository: wshobson/agents
- Install command: `npx skills add https://github.com/wshobson/agents --skill backtesting-frameworks`
- Last updated: November 16, 2026

## What Backtesting Frameworks does

Building and validating trading strategy backtests with proper bias handling.

How do you build an event-driven trading backtester?

Event-driven backtester code, simulated order fills, slippage and commission model, and position tracking reports.

Best for: Developers building trading algorithms and quant strategies.

Not for: Quick one-off strategy tests without rigor.

- Handles look-ahead bias, survivorship bias, and transaction costs
- Walk-forward analysis patterns
- Monte Carlo analysis for uncertainty

## SKILL.md

## Backtesting Frameworks

Build robust, production-grade backtesting systems that avoid common pitfalls and produce reliable strategy performance estimates.

### When to Use This Skill

- Developing trading strategy backtests
- Building backtesting infrastructure
- Validating strategy performance
- Avoiding common backtesting biases
- Implementing walk-forward analysis
- Comparing strategy alternatives

### Core Concepts

#### 1. Backtesting Biases

| Bias             | Description               | Mitigation              |
| ---------------- | ------------------------- | ----------------------- |
| **Look-ahead**   | Using future information  | Point-in-time data      |
| **Survivorship** | Only testing on survivors | Use delisted securities |
| **Overfitting**  | Curve-fitting to history  | Out-of-sample testing   |
| **Selection**    | Cherry-picking strategies | Pre-registration        |
| **Transaction**  | Ignoring trading costs    | Realistic cost models   |

#### 2. Proper Backtest Structure

```
Historical Data
      │
      ▼
┌─────────────────────────────────────────┐
│              Training Set               │
│  (Strategy Development & Optimization)  │
└─────────────────────────────────────────┘
      │
      ▼
┌─────────────────────────────────────────┐
│             Validation Set              │
│  (Parameter Selection, No Peeking)      │
└─────────────────────────────────────────┘
      │
      ▼
┌─────────────────────────────────────────┐
│               Test Set                  │
│  (Final Performance Evaluation)         │
└─────────────────────────────────────────┘
```

#### 3. Walk-Forward Analysis

```
Window 1: [Train──────][Test]
Window 2:     [Train──────][Test]
Window 3:         [Train──────][Test]
Window 4:             [Train──────][Test]
                                     ─────▶ Time
```

### Detailed worked examples and patterns

Detailed sections (starting with `## Implementation Patterns`) live in `references/details.md`. Read that file when the navigation summary above is insufficient.

### Best Practices

#### Do's

- **Use point-in-time data** - Avoid look-ahead bias
- **Include transaction costs** - Realistic estimates
- **Test out-of-sample** - Always reserve data
- **Use walk-forward** - Not just train/test
- **Monte Carlo analysis** - Understand uncertainty

#### Don'ts

- **Don't overfit** - Limit parameters
- **Don't ignore survivorship** - Include delisted
- **Don't use adjusted data carelessly** - Understand adjustments
- **Don't optimize on full history** - Reserve test set
- **Don't ignore capacity** - Market impact matters

## Backtesting Frameworks FAQ

### What biases should I handle in backtesting?

Look-ahead bias, survivorship bias, overfitting, selection bias, and transaction costs.

### What is walk-forward analysis?

A validation technique that rolling-retrains on expanding historical windows, testing only out-of-sample data.

### Is Backtesting Frameworks safe to install?

skills.sh reports 3 of 3 security scanners passed. Review the Security Audits panel on this page before installing in production.

## Machine access

- [Sitemap](https://skillselion.com/sitemap.xml)
- [llms.txt](https://skillselion.com/llms.txt)
- [llms-full.txt](https://skillselion.com/llms-full.txt)
- [Developer resources](https://skillselion.com/developers)
- [OpenAPI spec](https://skillselion.com/openapi.json)
- [MCP handshake](https://skillselion.com/.well-known/mcp)
- [API catalog](https://skillselion.com/.well-known/api-catalog)
- [AI catalog](https://skillselion.com/.well-known/ai-catalog.json)
- [Pricing](https://skillselion.com/pricing.md)
- [Auth](https://skillselion.com/auth.md)
- [AGENTS.md](https://skillselion.com/AGENTS.md)
- [Contact](https://skillselion.com/contact)
- [Home](https://skillselion.com/)
