Build an AI Short-Drama Production Pipeline With Agents in 14 Days
Taught in ChineseWeek 1 · From One Sentence to One Finished Episode
What an AI Short-Drama Production Pipeline Looks Like: Breaking Down the Stages, a Task-Graph Architecture, and Choosing Among Four Categories of Generation Models
First get clear on which stages an episode of vertical short drama passes through and where the money goes, translate those stages into a directed acyclic graph, then write the four generation-provider interfaces that run through the whole course, so the whole line keeps working even with no balance left.
The Script Agent: Turning a Single Sentence Into Structured Data — Character Cards, Scenes, and Shots
Get the model to produce script data a program can consume directly instead of a piece of prose, add a reviewer role that polishes it against judgeable criteria, and distill settings shared across episodes into a bible file.
Character Consistency: Character Sheets, Reference Images, and Style Locking — Keeping the Same Person the Same Person in Every Shot
Wire up an image generation API, batch-produce character sheets and prop/scene assets from the shot data, lock down a look with reference images and fixed templates, and store the assets in a reusable library.
From Shot to Footage: Image-to-Video, Polling Async Tasks, and Retrying Failures
Video generation is the slowest, most expensive, and most failure-prone step in the whole pipeline; today turn it into a safely retryable async task, and learn to write prompts in shot language the model actually understands.
Voiceover, Subtitles, and Audio Tracks: Multi-Character Voices, Timeline Alignment, and Subtitle Files
Give every character their own voice, use voice duration to correct shot duration in return, generate subtitle files with a correct timeline, and get the relationship between background music and dialogue right.
The Editing Bay: Assembling Footage Into One Vertical Cut With ffmpeg
Assemble shot footage, voiceover, subtitles, and background audio along a timeline into one vertical finished cut, add transitions and a cover, and have the program generate the command from a structured timeline rather than letting the model improvise it.
One Episode Wrapped: Stringing Six Stages Into an End-to-End Pipeline and Tallying the First Bill
String script, assets, shots, voiceover, and assembly into one line a single command can run end to end, measure the time and cost of each stage, and find the pipeline's three most fragile points right now.
Week 2 · From One Episode to a Parallel, Reviewable, Cost-Controlled Production Line
A Workflow Engine: Turning the Pipeline Into a Resumable Task Graph
Replace the sequential script with a workflow engine that has nodes, dependencies, and state, so every step's output lands on disk, every step is idempotent, and a failure resumes from the checkpoint instead of burning money from scratch.
Concurrency and Quotas: Starting Multiple Episodes at Once Without Blowing Through Any Provider's Limits
Produce multiple episodes in parallel, use a queue, a token bucket, and priorities to control the load on each provider, and handle the queuing, starvation, and placeholder problems long tasks hit under concurrency.
The Review Room: A Human-in-the-Loop Backend for Previewing, Editing Lines, and Regenerating a Single Shot
A pipeline can't be fully automatic; today give it a web review console: view assets shot by shot, edit dialogue, regenerate a single shot, and turn every human edit into a traceable version.
Quality Control and Compliance: Machine Review, Content Safety, Generated-Content Labeling, and Copyright Boundaries
Use a vision model to automatically catch flaws in a finished cut, put content-safety checks into the pipeline, and land the two hard lines — generated-content labeling and copyright — in the export step.
Cost and Model Routing: Choosing a Model per Stage, Caching, Degradation, and a Budget Circuit Breaker
Get a clear tally of the whole line's costs, tier models per stage, bring cost down with caching and degradation, and fit every run with a budget circuit breaker that actually pulls the brake.
Distribution: Adapting to Multiple Platform Specs, Generating Covers and Titles, Batch Export, and Feeding Data Back
Export the same finished cut in multiple versions per platform's spec, pair it with a clickable cover and title, and feed post-release data back to guide how the next episode gets shot.
A Five-Episode Season: Batch Production, Portfolio Packaging, and a Short-Drama Pipeline Interview Deep Dive
Produce a five-episode season in one run, package the whole pipeline into a portfolio piece that reads in three minutes, and turn fourteen days of engineering judgment into interview answers that hold up.