Home / Documentation / Video Generation

Video Generation Tutorial

12 min read Intermediate Updated Jan 5, 2025

Bring your storyboards to life with video generation. Create short video clips for each frame to visualize motion and timing.

Video Generation Basics

AI Storyboard supports two video generation modes:

  • Image to Video: Animate a generated storyboard image
  • Text to Video: Generate video directly from description

Image to Video Mode

Generate Video from Image

  1. Ensure frame has a generated image
  2. Select the frame in scene list
  3. Click "Generate Video" button
  4. Choose video duration (2-4 seconds)
  5. Specify motion type (camera movement, subject motion)
  6. Wait for generation (typically 20-40 seconds)
  7. Preview the generated video

Motion Types

  • Camera Push In: Slow zoom toward subject
  • Camera Pull Out: Slow zoom away from subject
  • Pan Left/Right: Horizontal camera movement
  • Tilt Up/Down: Vertical camera movement
  • Subject Motion: Character or object movement within frame

Text to Video Mode

Generate Video from Description

  1. Select a frame (with or without generated image)
  2. Click "Text to Video" in toolbar
  3. Enter video-specific description
  4. Set duration and motion preferences
  5. Click "Generate"
  6. Wait for generation

Text to Video Prompt Tips

Focus on motion and action:

Detective slowly raises flashlight, beam cuts through darkness,
dust particles floating in light, camera slowly pushes forward

Video Prompt Optimization

Effective Video Prompts

Good video prompts emphasize:

1. Motion - What moves

Character turns head slowly, hand reaches toward object

2. Camera Movement - How camera moves

Slow push in, gentle pan right following subject

3. Timing - Pacing of action

Gradual movement, steady pace, smooth transitions

4. Atmosphere - Environmental motion

Smoke drifting, dust particles, shadows lengthening

Quality Optimization

Resolution and Duration

  • Shorter videos (2-3 sec) often have better quality
  • Longer videos (4 sec) show more complex motion
  • Balance duration with quality needs

Styling Tips

  • Maintain consistency with generated image
  • Use subtle motion for professional look
  • Avoid excessive camera movement
  • Test different motion types to find best match

Practical Examples

Example 1: Dramatic Reveal

Setup: Character discovers important clue

Video Prompt:

Camera slowly pushes in on detective's face as she notices the clue,
expression shifts from confusion to realization, dramatic lighting on eyes

Example 2: Environmental Scene

Setup: Establishing shot of location

Video Prompt:

Slow pan across abandoned warehouse interior, dust motes floating in light beams,
shadows creating mystery, subtle atmosphere of abandonment

Example 3: Action Movement

Setup: Character moving through scene

Video Prompt:

Detective walks forward slowly, flashlight beam cutting through darkness,
camera tracking backward, surroundings gradually revealed

Batch Video Generation

Similar to image generation:

  1. Select multiple frames
  2. Click "Batch Generate Videos"
  3. Monitor progress in status bar
  4. Videos generate sequentially
  5. Review each as it completes

Post-Production Tips

Export and Use

  • Export videos in highest quality available
  • Use for pitch presentations and previews
  • Edit together for rough cuts
  • Reference for final production

Integration with Editing

  • Import into video editing software
  • Add transitions between storyboard videos
  • Overlay with temp audio and dialogue
  • Use as animatic for timing reference