Best Practices Check

# Best Practices Verification

Verify that skills in this repository align with current Microsoft Fabric best practices from official documentation and community sources.

## When to Use

- After creating or updating a skill
- To ensure a skill covers recommended patterns
- To identify gaps in guidance
- Before major releases to validate content currency

## Workflow

### Step 1: Identify Target Skill

Parse the user's request to identify which skill to verify:

| User Request | Target Skill |
|--------------|--------------|
| "check best practices for spark consumption" | `spark-consumption-cli` |
| "validate best practices for sqldw authoring" | `sqldw-authoring-cli` |
| "best practices for medallion" | `skills/e2e-medallion-architecture/SKILL.md` |
| "check best practices for SQL endpoint" | `sqldw-consumption-cli` |

**Skill name normalization:**
- "spark" → `spark-authoring-cli` or `spark-consumption-cli` (ask if ambiguous)
- "sqldw", "warehouse", "SQL endpoint" → `sqldw-authoring-cli` or `sqldw-consumption-cli`
- "medallion", "bronze/silver/gold" → `skills/e2e-medallion-architecture/SKILL.md`
- "data engineering" → `spark-authoring-cli`

### Step 2: Read Skill Content

Load the target skill's SKILL.md and any referenced resources:

```bash
# Example: Read skill content
cat skills/spark-consumption-cli/SKILL.md

# If skill has resources folder, read those too
ls skills/spark-consumption-cli/resources/ 2>/dev/null && \
  cat skills/spark-consumption-cli/resources/*.md
```

Extract key topics covered:
- Must/Prefer/Avoid guidance
- Specific patterns mentioned
- Technologies referenced
- Example scenarios

### Step 3: Search for Current Best Practices

Use web search to find current Microsoft Fabric best practices. **Always include "Microsoft Fabric" in search queries** to ensure results are Fabric-specific.

**Search queries to execute** (adjust based on skill topic):

| Skill Type | Search Queries |
|------------|----------------|
| Spark/Data Engineering | "Microsoft Fabric Spark best practices 2025", "Fabric Lakehouse optimization", "Fabric notebook development best practices" |
| SQL Endpoint/Warehouse | "Microsoft Fabric Data Warehouse best practices", "Fabric T-SQL performance optimization", "Fabric SQL endpoint security best practices" |
| Medallion Architecture | "Microsoft Fabric medallion architecture best practices", "Fabric Bronze Silver Gold layer design", "Fabric lakehouse data modeling" |
| General | "Microsoft Fabric {topic} best practices", "Fabric {topic} performance tuning", "Fabric {topic} security" |

**Priority sources** (weight these higher):
1. `learn.microsoft.com/en-us/fabric/` — Official Microsoft documentation
2. `blog.fabric.microsoft.com/` — Official Fabric blog
3. `techcommunity.microsoft.com/` — Microsoft Tech Community
4. Recent conference talks (Ignite, Build) transcripts
5. Fabric CAT team blogs and whitepapers

### Step 4: Compare and Analyze

Create a comparison matrix:

```markdown
| Best Practice | Source | Covered in Skill? | Notes |
|---------------|--------|-------------------|-------|
| Use starter pools for Livy sessions | MS Docs | ✅ Yes | Session Management |
| Enable adaptive query execution | Tech Community | ⚠️ Partial | Mentioned but no config example |
| Avoid SELECT * on large tables | MS Docs | ✅ Yes | Avoid section |
| Use V-Order for read-heavy workloads | Fabric Blog | ❌ No | Gap - should add |
```

### Step 5: Generate Repo