Videoagent Director

🎬 VideoAgent Director

Use when: The user wants to produce a video from a natural-language idea — a brand video, short film, social reel, product ad, or any creative concept. Also use for "make a storyboard", "create a scene breakdown", or "produce a short clip about X".

You are the creative director. The user describes what they want. You handle everything — shot planning, prompt writing, asset generation — without asking the user to write any prompts.

---

Your Responsibilities

The user gives you an idea. You do the rest.

• Break the idea into the right number of shots
• Write all image, video, and audio prompts internally (never ask the user to write them)
• Execute each shot via director.js
• Return a clean, visual production report

Never surface prompt details, model names, or technical parameters to the user unless explicitly asked.

---

Workflow

Step 1 — Understand the brief (one pass)

From the user's message, infer:

• Concept — What is the video about?
• Format — Vertical (9:16) for social/mobile, landscape (16:9) for film/desktop, square (1:1) for feed. Default to 16:9 if unclear.
• Tone — Cinematic, energetic, calm, playful, corporate, dramatic
• Length — Short (15–20 s), standard (30 s), long (45–60 s). Default to 30 s.

If any of these is truly ambiguous, ask one clarifying question only. Otherwise, proceed.

Step 2 — Show a one-line storyboard for quick confirmation

Plan all shots internally, then show the user only a compact table — no prompts, no technical details:

🎬 **[Title]** · [N] shots · [format] · ~[duration]s

| # | Scene | Audio |
|---|-------|-------|
| 1 | Rainy street, wide establishing | music |
| 2 | Neon sign reflection in puddle | rain SFX |
| 3 | Person with umbrella, tracking | city ambience |
| 4 | Fade to black on neon glow | music |

Looks good? I'll start generating.

Wait for a single word of approval (e.g. "yes", "go", "ok", "好的", or any positive reply) before proceeding.

Step 3 — Execute shot by shot

Call director.js once per shot after user confirms.

node {baseDir}/tools/director.js \
  --shot-id <n> \
  --image-prompt "<your internally crafted image prompt>" \
  --video-prompt "<your internally crafted motion prompt>" \
  --audio-type <music|sfx|tts> \
  --audio-prompt "<your internally crafted audio prompt>" \
  --duration <seconds> \
  --aspect-ratio <ratio> \
  --style "<global style string you chose>"

For text-to-video shots (no reference frame needed):

node {baseDir}/tools/director.js \
  --shot-id <n> \
  --skip-image \
  --video-prompt "<full scene description + motion>" \
  --duration <seconds> \
  --aspect-ratio <ratio>

For shots where the user provided an image:

node {baseDir}/tools/director.js \
  --shot-id <n> \
  --image-url "<url from user>" \
  --video-prompt "<motion description>" \
  --audio-type <type> \
  --audio-prompt "<sound>" \
  --duration <seconds>

Step 4 — Present the results

After all shots are complete, show only the production output — no prompts, no model names:

## 🎬 [Title]

**[Shot count] shots · [format] · [total duration]**

---

**Shot 1 — [Scene Name]**
🖼 [image_url]
🎬 [video_url]
🔊 [audio description or "no audio"]

**Shot 2 — [Scene Name]**
...

---
Ready to adjust any shot or generate more?

---

Shot Planning Reference (internal use only)

Shots by format

Shot sequence patterns

Brand / product (30 s): Establishing → Product detail close-up → Action/usage → Sensory moment → Lifestyle → Brand outro

Social reel (15 s): Hook (bold visual) → Core message → Payoff/result → CTA

Short film teaser (45 s): World → Character → Inciting moment → Action/tension → Emotional peak → Cliffhanger

Audio rule

• Assign music to the opening shot and closing shot
• Assign SFX to action shots (pouring, movement, impact)
• Use TTS only if user explicitly asks for narration or voiceover
• Omit audio for transitional shots when in doubt

Style consistency

Pick ONE style lock before executing and use it in --style for every shot. Example: cinematic, warm amber tones, shallow depth of field.

---

Example

User: "Make a short video about a rainy Tokyo street at night."

You internally plan:

• 4 shots · 16:9 · ~20 s
• Style: cinematic, neon-wet streets, shallow depth of field, rain
• Shot 1: wide establishing (music), Shot 2: close-up puddle reflection (SFX rain), Shot 3: person with umbrella tracking (SFX city ambience), Shot 4: neon sign fade-out (music outro)

Then execute all 4 shots silently and show only the results.

🎬 VideoAgent Director

Turn any creative idea into a shot-by-shot production. The Director skill plans a storyboard from your concept and generates each shot's assets — reference image, video clip, and audio — automatically.

One prompt. A complete storyboard. All assets generated.

---

What It Does

1. Analyzes your brief — extracts format, tone, key shots 2. Plans the storyboard — breaks the concept into 4–8 shots with clear visual and audio direction 3. Executes shot by shot — for each shot:

• Generates a reference frame (image)
• Uses it to create a video clip (image-to-video for visual consistency)
• Adds audio — music, SFX, or voiceover

4. Delivers the production — a formatted storyboard with all asset URLs

---

Quick Start

Just describe what you want in plain language:

"Make a 30-second brand video for a minimalist coffee brand. Instagram vertical format."

"Create a short film teaser for a sci-fi story about a lone astronaut discovering a signal from Earth."

"Produce a product launch reel for a smartwatch. 15 seconds, energetic."

No prompts to write, no model to pick. The Director handles everything and delivers the final assets.

---

Models Used

All services run through hosted proxies — no API keys needed.

---

Supported Formats

---

Shot Pipeline

For each shot in the storyboard:

User intent
    ↓
Storyboard plan (shot list with prompts)
    ↓ [for each shot]
Image generation (reference frame)
    ↓
Video generation (image-to-video)
    ↓
Audio generation (music / SFX / TTS)
    ↓
Shot result: { image_url, video_url, audio_url }

---

Tool Usage

node tools/director.js \
  --shot-id 1 \
  --image-prompt "close-up of hands holding a warm coffee cup, morning light, editorial" \
  --video-prompt "camera slowly pushes in, steam curls upward" \
  --audio-type music \
  --audio-prompt "gentle acoustic guitar, warm morning mood" \
  --duration 5 \
  --aspect-ratio 9:16 \
  --style "warm amber tones, shallow depth of field, editorial photography"

Full parameter reference: SKILL.md

---

Environment Variables

All optional — the skill works out of the box with hosted proxies.

---

Knowledge Base

• references/storyboard_guide.md — Shot types, pacing, audio strategy, and prompt glossary

Storyboard Guide — Prompt Patterns and Pacing

A reference for writing effective storyboard scripts. Covers shot types, pacing rules, and prompt language for each asset type.

---

Shot Structure

Every shot in a storyboard has four elements:

---

Shot Types and When to Use Them

Establishing Shot

• Purpose: Open a scene, provide context and scale
• Camera: Wide, high angle, or drone
• Example: Aerial shot of a coastal town at sunset, warm orange glow, cinematic wide angle
• Duration: 5–8 s

Close-Up

• Purpose: Emotion, product detail, texture
• Camera: Tight framing, macro if needed
• Example: Extreme close-up of coffee beans in a scoop, shallow depth of field, soft studio light
• Duration: 3–5 s

Medium Shot

• Purpose: Action, character interaction, storytelling
• Camera: Waist-up framing
• Example: Medium shot of a barista at work, steam rising from espresso machine in background
• Duration: 4–6 s

Tracking Shot

• Purpose: Follow a subject, build momentum
• Camera: Smooth lateral or forward movement
• Example: Camera tracks alongside a cyclist through a city street, motion blur on edges, golden hour
• Duration: 5–8 s

POV Shot

• Purpose: Immersive, first-person experience
• Camera: Handheld or slightly shaky
• Example: POV looking down at hands holding a warm mug, cozy morning light, soft focus background
• Duration: 3–5 s

Cutaway

• Purpose: B-roll, context, transition
• Camera: Static or slow movement
• Example: Slow zoom into a rain-streaked window, city lights blurred in background
• Duration: 3–5 s

---

Pacing Patterns

Brand / Product Video (30 s)

Shot 1 (6 s) — Establishing: set the scene and mood
Shot 2 (5 s) — Close-up: product or key detail
Shot 3 (5 s) — Action: someone using the product
Shot 4 (5 s) — Close-up: sensory moment (steam, texture, taste)
Shot 5 (4 s) — Medium: person enjoying / benefitting
Shot 6 (5 s) — Logo / brand reveal

Social Reel (15 s, vertical 9:16)

Shot 1 (3 s) — Hook: bold visual that grabs attention in 1 s
Shot 2 (4 s) — Core message: product / action
Shot 3 (4 s) — Payoff: reaction or result
Shot 4 (4 s) — CTA or outro

Short Film Teaser (45 s)

Shot 1 (8 s) — Establishing: world and atmosphere
Shot 2 (6 s) — Character introduction
Shot 3 (5 s) — Inciting moment / conflict hint
Shot 4 (6 s) — Action or tension
Shot 5 (8 s) — Emotional peak
Shot 6 (6 s) — Unresolved cliffhanger
Shot 7 (6 s) — Title card or tagline

---

Audio Strategy

Music

Best for: sustained mood, emotional continuity across multiple shots.

Use music for: opening shot, ending shot, transitional shots without strong action.

Sound Effects (SFX)

Best for: specific events within a shot.

Use SFX for: action shots, product shots, sensory moments.

Narration / TTS

Best for: story-driven content, explainer videos, documentary style.

Rules:

• Keep each line under 20 words
• Match the line to the shot duration (5 s shot ≈ 10–15 words at normal pace)
• Write conversational, not formal

---

Prompt Language Glossary

Image prompts — composition terms

• close-up, extreme close-up, medium shot, wide shot, aerial, overhead
• rule of thirds, centered composition, foreground / background
• shallow depth of field, bokeh background, sharp throughout

Image prompts — lighting

• soft morning light, golden hour, blue hour, overcast diffused
• studio lighting, backlit silhouette, rim light, neon-lit
• candlelight, harsh midday sun, fog-filtered light

Image prompts — style modifiers

• cinematic, editorial photography, film still, 35mm grain
• product shot, commercial photography, lifestyle photography
• illustration, concept art, 3D render, watercolor

Video prompts — camera movement

• static shot (no movement)
• camera slowly pushes in / pulls back
• slow pan left / right
• smooth upward tilt
• tracking alongside the subject
• drone ascending slowly
• handheld, slight sway

Video prompts — subject motion

• steam rises gently, fabric sways in breeze, water ripples
• person walks toward camera, hand reaches into frame
• eyes close slowly, slight smile forms
• liquid pours in slow motion

---

Style Consistency

To keep all shots visually cohesive, choose a style lock before generating and append it to every prompt.

Example style locks

---

Common Mistakes to Avoid