Each model got the same frozen prompt and brand pack, then directed and built its own result. One trial per model. Unranked, with no blind votes collected. This diagnostic showcase is separate from the published July dataset and is a subset of the September route panel.
All four exports passed encoded checks. A valid export and a completed agent workflow are separate outcomes. Costs below are token-based estimates of raw provider spend. Invoice totals and billed account charges are separate measures. CLI generation time excludes export.
10s · 300 frames · 30fps · 1920×1080 · silent
gpt-6-astraAI review noteReadable typography connects an animated preview with editable React code. Abstract motion and long-held layouts limit motion contrast.
10s · 300 frames · 30fps · 1920×1080 · silent
claude-fable-5-1AI review notePreview-to-code connections show editable scenes. A sparse opening and blank transition interrupt the flow. The displayed baz create command is unsupported.
10s · 300 frames · 30fps · 1920×1080 · silent
gemini-3.7-flashAI review noteReadable headlines and consistent styling have little visual development. The video includes unsupported statistics, speed claims, technical labels, and a baz build command.
10s · 300 frames · 30fps · 1920×1080 · silent
gemini-3.8-flashAI review noteReadable headlines sit in three held interface layouts. Small technical text and limited motion contrast weaken the result. Simulated editor details include unsupported claims.
Review notes summarize AI assessments of sampled frames. Unsupported commands, statistics, and editor claims inside these model-generated videos are output errors; they are not product facts about baz.studio.
motionbench-agentic-v1 · Same candidate model in both the director and code-generation roles.
a9b7cda9924763aee2044b037aafa9aa4f2e0982c919cb6b43c3700186186b0b75f639a1a443b4f8cc4b9e3520393d0ce310674f81c39daac6b8b5aa6abfa157“Make a 10-second launch video for baz.studio. Decide the strongest product story, create your own creative brief and execution plan, then build, review, and deliver the finished video. You are directing this - the available patterns and defaults are a toolbox, not a script; use, combine, or ignore them as your own creative judgment requires. No audio.”