{"updatedAt":"2026-09-07T14:03:55.104Z","panelCount":56,"panelId":"motionbench-agentic-v1-2026-09","official":false,"rows":[{"modelId":"gpt-6-astra","displayName":"GPT-6 Astra","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/nx8x57xprc.mp4","providerCostEstimateUsd":2.6041,"generationSeconds":358.365,"encodedPass":true,"reviewNote":"Readable typography connects an animated preview with editable React code. Abstract motion and long-held layouts limit motion contrast.","recoveryNote":null,"attemptCount":1},{"modelId":"claude-fable-5-1","displayName":"Claude Fable 5.1","provider":"anthropic","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/b7fao2twza.mp4","providerCostEstimateUsd":3.9595,"generationSeconds":421.481,"encodedPass":true,"reviewNote":"Preview-to-code connections show editable scenes. Sparse transitions interrupt the flow. The displayed baz create command is unsupported.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-3.8-flash","displayName":"Gemini 3.8 Flash","provider":"google","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/adlx9nd16v.mp4","providerCostEstimateUsd":0.3179,"generationSeconds":272.961,"encodedPass":true,"reviewNote":"Readable headlines sit in held interface layouts. Small technical text, limited motion contrast, and unsupported simulated editor claims weaken the result.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-3.7-flash","displayName":"Gemini 3.7 Flash","provider":"google","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/758prdrs4t.mp4","providerCostEstimateUsd":0.3737,"generationSeconds":236.415,"encodedPass":true,"reviewNote":"Readable headlines and consistent styling have little visual development. Unsupported statistics, speed claims, technical labels, and a baz build command appear.","recoveryNote":null,"attemptCount":1},{"modelId":"grok-4.6","displayName":"Grok 4.6","provider":"xai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/pvmyefctyt.mp4","providerCostEstimateUsd":2.0246,"generationSeconds":2296.102,"encodedPass":true,"reviewNote":"Generic placeholders, repeated blur reveals, and mostly held layouts. No unsupported claims were observed in the sampled frames.","recoveryNote":null,"attemptCount":1},{"modelId":"glm-5.3","displayName":"GLM-5.3","provider":"openrouter","status":"incomplete","agentStatus":"cancelled","videoUrl":"https://media.baz.studio/export-masters/sgz35u3zi2.mp4","providerCostEstimateUsd":0.4338,"generationSeconds":2400.018,"encodedPass":true,"reviewNote":"After the opening launch-video prompt, all sampled frames from 2.5 seconds through the end show only background. The video is unfinished.","recoveryNote":"Generation cancelled after the 40-minute timeout. A separate export of the unchanged partial timeline is playable, but the video remains unfinished.","attemptCount":1},{"modelId":"glm-5.3-flash","displayName":"GLM-5.3 Flash","provider":"openrouter","status":"incomplete","agentStatus":"cancelled","videoUrl":null,"providerCostEstimateUsd":null,"generationSeconds":2400.021,"encodedPass":null,"reviewNote":null,"recoveryNote":"An earlier attempt was interrupted by infrastructure failure. The fresh trial reached the fixed 40-minute generation timeout and was cancelled. A code-generation response returned empty and another call failed during a network outage. Their provider costs were not retained, so the recorded partial usage cannot establish the total trial cost. No completed export is available.","attemptCount":2},{"modelId":"qwen3.8-max-0902","displayName":"Qwen3.8 Max 0902","provider":"openrouter","status":"incomplete","agentStatus":"cancelled","videoUrl":"https://media.baz.studio/export-masters/yci7zcw2t7.mp4","providerCostEstimateUsd":null,"generationSeconds":2400.029,"encodedPass":true,"reviewNote":"Sampled frames show a mostly empty paper grid that changes to a dark grid near the end. Small timeline text is visible, but there is no main-canvas product story, proof, or CTA. Provisional AI frame review.","recoveryNote":"An earlier attempt was interrupted by infrastructure. Generation reached the fixed 40-minute limit. The saved composition was exported. A code-generation response returned empty before its usage was recorded. The complete provider cost for this trial is unknown.","attemptCount":2},{"modelId":"qwen3.8-flash","displayName":"Qwen3.8 Flash","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":null,"providerCostEstimateUsd":null,"generationSeconds":1808.243,"encodedPass":null,"reviewNote":null,"recoveryNote":"An earlier attempt was interrupted by infrastructure. This trial ended with a provider request timeout after about 30 minutes, before creating a scene. No video was exported. Provider cost is unknown because no response usage was recorded.","attemptCount":2},{"modelId":"deepseek-v4-pro-0813","displayName":"DeepSeek V4 Pro 0813","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/ccmi7gavfb.mp4","providerCostEstimateUsd":0.6155,"generationSeconds":1307.531,"encodedPass":true,"reviewNote":"Sampled frames show a clear baz.studio launch story with clean brand language. The main weakness is static pacing with some blurred text. Provisional AI frame review.","recoveryNote":"Earlier attempt: The local attempt lost provider and database connectivity, then its heartbeat expired. No reviewed export or reconciled full-attempt metrics are available. An automatic production continuation was stopped before further testing.","attemptCount":2},{"modelId":"hy4-preview","displayName":"Tencent Hy4 Preview","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/uests18z66.mp4","providerCostEstimateUsd":0.4884,"generationSeconds":1816.02,"encodedPass":true,"reviewNote":"The sampled frames show a clear launch story with strong brand fit. The main weakness is possible slow pacing in the hold sections. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"nemotron-3.5-lightning","displayName":"Nemotron 3.5 Lightning","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/hcsq9ttxw7.mp4","providerCostEstimateUsd":0.0583,"generationSeconds":392.387,"encodedPass":true,"reviewNote":"Every sampled frame shows a Scene Error overlay: the background scene interpolates a color hex with a numeric interpolator, so the composition does not render as intended. Provisional AI frame review confirmed by operator inspection.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"claude-haiku-4-5","displayName":"Claude Haiku 4.5","provider":"anthropic","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/0lqn5is9q9.mp4","providerCostEstimateUsd":0.2652,"generationSeconds":251.565,"encodedPass":true,"reviewNote":"Sampled frames show clipped graphics, overlapping labels, contradictory zero-spend copy, and invalid CLI syntax.","recoveryNote":null,"attemptCount":1},{"modelId":"claude-sonnet-5","displayName":"Claude Sonnet 5","provider":"anthropic","status":"interrupted","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/6fo6gn5nmn.mp4","providerCostEstimateUsd":0.9822,"generationSeconds":526.178,"encodedPass":true,"reviewNote":"Clean approved copy and brand close. Sparse typing and small placeholder graphics do not show a finished product video or editable scenes.","recoveryNote":"Generation completed. Original QA failed during a local build-cache collision. The unchanged saved scenes passed a separate QA/export recovery.","attemptCount":1},{"modelId":"claude-sonnet-4-6","displayName":"Claude Sonnet 4.6","provider":"anthropic","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/rwfmfe09yc.mp4","providerCostEstimateUsd":0.6955,"generationSeconds":345.509,"encodedPass":true,"reviewNote":"A readable problem-to-CLI story has sparse, mostly held layouts and blank transition samples. The displayed baz create launch-video command is unsupported, and the video gives little visual proof of Skills or editable scenes.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gpt-5.6-sol","displayName":"GPT-5.6 Sol","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/k0wdy7rivp.mp4","providerCostEstimateUsd":1.6255,"generationSeconds":421.877,"encodedPass":true,"reviewNote":"The prompt-to-timeline, skill-selection, and editable-code sequence gives a concrete product story. A clipped Finale card, blurred or faint text, and an altered final wordmark weaken the result.","recoveryNote":null,"attemptCount":1},{"modelId":"gpt-5.6-terra","displayName":"GPT-5.6 Terra","provider":"openai","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/vclse50lf6.mp4","providerCostEstimateUsd":0.4071,"generationSeconds":114.959,"encodedPass":true,"reviewNote":"A coherent prompt-to-editable-code story uses the supplied brand palette. Abstract product proof, small labels, and a partially clipped code-panel title limit clarity.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gpt-5.6-luna","displayName":"GPT-5.6 Luna","provider":"openai","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/4kc47qrmsq.mp4","providerCostEstimateUsd":0.0901,"generationSeconds":290.454,"encodedPass":true,"reviewNote":"Frame samples show baz.studio branding, approved launch-video claims, a recipe/timeline visual, and an editable-code panel. The opener is nearly black, the early headline is clipped on the right edge, and some interface labels are too small to read.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gpt-5.5-low","displayName":"GPT-5.5 Low","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/bk1zidrkmf.mp4","providerCostEstimateUsd":1.6203,"generationSeconds":327.829,"encodedPass":true,"reviewNote":"Prompt and CLI views lead into reusable launch-video skills, a preview/code panel, and a baz.studio close. Blurred transitions, small low-contrast captions, a gray placeholder preview, and partially malformed decorative code weaken the proof.","recoveryNote":null,"attemptCount":1},{"modelId":"gpt-5.5-high","displayName":"GPT-5.5 High","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/a0r8mw665j.mp4","providerCostEstimateUsd":3.1787,"generationSeconds":1135.796,"encodedPass":true,"reviewNote":"A coherent prompt-to-recipe-to-editable-code story uses readable type and consistent brand styling. Several headline and editor layouts hold across sampled frames; pacing and transition feel need full playback review. Provisional AI frame review.","recoveryNote":"Earlier attempt: An infrastructure failure interrupted this attempt after generation started.","attemptCount":2},{"modelId":"gpt-5.5","displayName":"GPT-5.5","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/imenqskvrz.mp4","providerCostEstimateUsd":2.2347,"generationSeconds":468.586,"encodedPass":true,"reviewNote":"The sampled frames show a clear baz.studio product story with strong brand control. The main weakness is minor crop and blur during transitions. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"gpt-5.4-mini","displayName":"GPT-5.4 Mini","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/zmpulkevcs.mp4","providerCostEstimateUsd":0.2046,"generationSeconds":212.958,"encodedPass":true,"reviewNote":"The sampled frames show a branded launch story with a prompt-to-editable-code mechanism. The main weakness is broken and overlapping headline text. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"gpt-5.4","displayName":"GPT-5.4","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/g43t0oxvg2.mp4","providerCostEstimateUsd":1.1253,"generationSeconds":329.918,"encodedPass":true,"reviewNote":"The sampled frames show a clear baz.studio launch story with code and editor proof motifs. The main weakness is long hold time and some blurred small text. Provisional AI frame review.","recoveryNote":"Earlier attempt: An infrastructure failure interrupted this attempt after generation started.","attemptCount":2},{"modelId":"gpt-5.4-nano","displayName":"GPT-5.4 Nano","provider":"openai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/0hjkxmdw3g.mp4","providerCostEstimateUsd":0.0346,"generationSeconds":153.131,"encodedPass":true,"reviewNote":"The sampled frames show a clean text-led baz.studio launch message. The main weakness is limited visual development beyond fades and line motion. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-2.5-flash","displayName":"Gemini 2.5 Flash","provider":"google","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/qhgawrswq9.mp4","providerCostEstimateUsd":0.0851,"generationSeconds":161.069,"encodedPass":true,"reviewNote":"All 21 sampled frames show a Scene Error screen for the background scene. The exported file meets timing, size, and silence requirements but does not contain a usable launch video.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gemini-2.5-pro","displayName":"Gemini 2.5 Pro","provider":"google","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/3dir264psq.mp4","providerCostEstimateUsd":0.3123,"generationSeconds":301.51,"encodedPass":true,"reviewNote":"Frame samples show a minimal baz.studio launch spot with a problem line, prompt-strip motif, success check, and final wordmark. Several samples are blank or contain partial text, and the command-strip text is very small.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-3.6-flash","displayName":"Gemini 3.6 Flash","provider":"google","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/ao53enbg8z.mp4","providerCostEstimateUsd":0.3471,"generationSeconds":226.319,"encodedPass":true,"reviewNote":"Prompt, code, cards, and a CLI-style call to action form a clear visual system. Sampled frames include an empty transition and unsupported product labels and named-company references.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-3.5-flash-lite","displayName":"Gemini 3.5 Flash-Lite","provider":"google","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/6bl2s86e08.mp4","providerCostEstimateUsd":0.074,"generationSeconds":59.573,"encodedPass":true,"reviewNote":"Clean headline, code panel, and baz.studio wordmark sequence. Visible frames rely on long static holds and include a blank opening frame.","recoveryNote":null,"attemptCount":1},{"modelId":"gemini-3.1-pro-preview","displayName":"Gemini 3.1 Pro","provider":"google","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/84b09t0d7q.mp4","providerCostEstimateUsd":0.3603,"generationSeconds":341.558,"encodedPass":true,"reviewNote":"The approved prompt-to-motion and editable-code claims appear with a code window and final baz.studio wordmark. Sampled frames include blank dark transitions, tight text near a divider, and mostly static holds.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gemini-3.1-pro-preview-customtools","displayName":"Gemini 3.1 Pro Tools","provider":"google","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/03gxyyjq18.mp4","providerCostEstimateUsd":0.365,"generationSeconds":336.871,"encodedPass":true,"reviewNote":"Sampled frames show a clean prompt-to-code story with strong brand fit, but the motion may rely too much on long holds. Provisional AI frame review.","recoveryNote":"Earlier attempt: An infrastructure failure interrupted this attempt after generation started. The agent stopped before completing the workflow.","attemptCount":2},{"modelId":"minimax-m2.7","displayName":"MiniMax M2.7","provider":"minimax","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/v5sgq84pes.mp4","providerCostEstimateUsd":0.0895,"generationSeconds":283.009,"encodedPass":true,"reviewNote":"The sampled frames show a CLI-to-pipeline-to-logo story for baz.studio. The main weakness is long static or near-empty holds. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"minimax-m3","displayName":"MiniMax M3","provider":"minimax","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/axt4mim5rr.mp4","providerCostEstimateUsd":0.1101,"generationSeconds":280.872,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio launch arc with strong brand fit. The main weakness is slow, sparse motion between major beats. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"deepseek-v4-flash","displayName":"DeepSeek V4 Flash","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/yut467c4cj.mp4","providerCostEstimateUsd":0.0334,"generationSeconds":584.994,"encodedPass":true,"reviewNote":"The sampled frames show clean brand typography and approved claims. The main weakness is sparse motion with blank gaps. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"deepseek-v4-flash-0731","displayName":"DeepSeek V4 Flash 0731","provider":"openrouter","status":"incomplete","agentStatus":"cancelled","videoUrl":"https://media.baz.studio/export-masters/itfkrmiz22.mp4","providerCostEstimateUsd":0.0304,"generationSeconds":2399.986,"encodedPass":true,"reviewNote":"The sampled frames show blank screens and a scene generation failure. The main weakness is that no usable video was produced. Provisional AI frame review.","recoveryNote":"Generation reached the fixed 40-minute limit. The saved composition was exported.","attemptCount":1},{"modelId":"deepseek-v4-pro","displayName":"DeepSeek V4 Pro","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/ivul5yp6pi.mp4","providerCostEstimateUsd":0.1116,"generationSeconds":680.945,"encodedPass":true,"reviewNote":"The sampled frames show a clear baz.studio launch arc with typed problem text, a CLI prompt, and the wordmark. The main weakness is sparse motion and an awkward missing space in the CTA copy. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"kimi-k2.6","displayName":"Kimi K2.6","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/wafv8ou65b.mp4","providerCostEstimateUsd":0.5639,"generationSeconds":1441.075,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio text sequence with approved brand claims. The main weakness is sparse motion and one clipped headline. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"kimi-k2.7-code","displayName":"Kimi K2.7 Code","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":null,"providerCostEstimateUsd":0.3143,"generationSeconds":741.083,"encodedPass":null,"reviewNote":null,"recoveryNote":"Latest receipt note: Latest receipt did not pass the benchmark gates: agent_not_completed, requirements_failed, export_failed, mp4_missing, ffprobe_failed.","attemptCount":1},{"modelId":"kimi-k3","displayName":"Kimi K3","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/kngtnznzfe.mp4","providerCostEstimateUsd":1.7799,"generationSeconds":784.957,"encodedPass":true,"reviewNote":"Sampled frames show a clear CLI-to-video-to-code story for baz.studio. The main weakness is generic motion with brief title overlap. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"glm-5.2","displayName":"GLM-5.2","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/3z8g7l3lfm.mp4","providerCostEstimateUsd":0.3544,"generationSeconds":506.95,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio launch arc with readable text and brand colors. The main weakness is generic product-card imagery and some long held layouts. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"qwen3-coder-plus","displayName":"Qwen3 Coder Plus","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/61rae1ty98.mp4","providerCostEstimateUsd":0.2145,"generationSeconds":163.128,"encodedPass":true,"reviewNote":"Sampled frames show a sparse baz.studio title and prompt button, then a green accent dot. The main weakness is low story content and limited motion. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"qwen3.7-plus","displayName":"Qwen 3.7 Plus","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/9j0tjopyhb.mp4","providerCostEstimateUsd":0.4587,"generationSeconds":1064.042,"encodedPass":true,"reviewNote":"The sampled frames show a clean text-led launch message with approved baz.studio copy and wordmark. The main weakness is sparse motion with blank transition beats. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"qwen3.7-max","displayName":"Qwen 3.7 Max","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/gf6qi6f3ot.mp4","providerCostEstimateUsd":0.7042,"generationSeconds":1098.14,"encodedPass":true,"reviewNote":"Sampled frames show a prompt typed into a dark console, a bright transition, icons, and the baz.studio wordmark. The main weakness is a thin story with one overexposed transition that hides text. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"qwen3.7-flash","displayName":"Qwen 3.7 Flash","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/hdsukhpn8o.mp4","providerCostEstimateUsd":0.052,"generationSeconds":283.718,"encodedPass":true,"reviewNote":"The sampled frames show a clean launch explainer with a clear code-to-video story. The main weakness is slow, sparse motion in the middle. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"mistral-medium-3.5","displayName":"Mistral Medium 3.5","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/j78pyr7pmn.mp4","providerCostEstimateUsd":0.8697,"generationSeconds":158.218,"encodedPass":true,"reviewNote":"The sampled frames show a clean text-led launch video with clear brand colors and wordmark. The main weakness is sparse motion and long blank gaps. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"mistral-small-2603","displayName":"Mistral Small 2603","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/7shbugjppq.mp4","providerCostEstimateUsd":0.0209,"generationSeconds":133.348,"encodedPass":true,"reviewNote":"The workflow completed and the file passes encoded checks, but every sampled frame shows a Scene Error overlay: the background scene interpolates a color hex with a numeric interpolator, so the composition does not render as intended. Provisional AI frame review confirmed by operator inspection.","recoveryNote":null,"attemptCount":1},{"modelId":"nemotron-3-ultra-550b-a55b","displayName":"Nemotron 3 Ultra","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/q4xatwc82t.mp4","providerCostEstimateUsd":0.3545,"generationSeconds":304.64,"encodedPass":true,"reviewNote":"The sampled frames show a clean text-only launch message with approved baz.studio claims. The main weakness is very limited motion and several blank pauses. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"mimo-v2.5-pro","displayName":"MiMo V2.5 Pro","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/gd6uvol1f5.mp4","providerCostEstimateUsd":0.1596,"generationSeconds":1961.955,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio launch sequence with wordmark, claims, and a code editor. The main weakness is sparse motion and limited product proof. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1},{"modelId":"gemini-3.5-flash","displayName":"Gemini 3.5 Flash","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/yx2k4s031c.mp4","providerCostEstimateUsd":0.79,"generationSeconds":257.858,"encodedPass":true,"reviewNote":"Sampled frames show a coherent baz.studio story from source video to recipe schema to editable code, with readable branded type. An automated error-screen check flagged seven pale frames, but manual inspection found no error overlay, so the flag needs playback confirmation. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"qwen3.8-max-openrouter","displayName":"Qwen3.8 Max (OpenRouter)","provider":"openrouter","status":"incomplete","agentStatus":"cancelled","videoUrl":"https://media.baz.studio/export-masters/9czsibe0os.mp4","providerCostEstimateUsd":0.7446,"generationSeconds":2399.999,"encodedPass":true,"reviewNote":"The sampled frames show a partial editable-code sequence, but error screens and a black ending dominate the video. The main weakness is failed scene generation. Provisional AI frame review.","recoveryNote":"Generation reached the fixed 40-minute limit. The saved composition was exported.","attemptCount":1},{"modelId":"muse-spark-1.1","displayName":"Muse Spark 1.1","provider":"openrouter","status":"incomplete","agentStatus":"failed","videoUrl":null,"providerCostEstimateUsd":0,"generationSeconds":7.533,"encodedPass":null,"reviewNote":null,"recoveryNote":"The provider refused the request with HTTP 403: this model requires an 18+ age confirmation on the OpenRouter account. No generation ran and no provider cost was recorded. This is a provider access gate, not a candidate outcome.","attemptCount":1},{"modelId":"hy3","displayName":"Tencent Hy3","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/r55helcrk0.mp4","providerCostEstimateUsd":0.0536,"generationSeconds":436.887,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio launch message with code and chart visuals. The main weakness is generic motion structure with long holds. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"step-3.7-flash","displayName":"Step 3.7 Flash","provider":"openrouter","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/53ozx1md8t.mp4","providerCostEstimateUsd":0.1415,"generationSeconds":710.414,"encodedPass":true,"reviewNote":"The sampled frames show a clear baz.studio pitch with correct brand cues. The main weakness is text overlap during key transitions. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"grok-4.5","displayName":"Grok 4.5","provider":"xai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/9bi8dq5fee.mp4","providerCostEstimateUsd":0.6879,"generationSeconds":330.209,"encodedPass":true,"reviewNote":"The sampled frames show a clean baz.studio launch arc with strong typography and brand fit. The main weakness is sparse presentation-style motion with some card overlap. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"grok-build-0.1","displayName":"Grok Build 0.1","provider":"xai","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/16f6mlsxpt.mp4","providerCostEstimateUsd":0.2423,"generationSeconds":674.348,"encodedPass":true,"reviewNote":"The sampled frames show a clean text-led baz.studio pitch with strong brand fit. The main weakness is sparse motion and several empty moments. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"claude-opus-5","displayName":"Claude Opus 5","provider":"anthropic","status":"complete","agentStatus":"completed","videoUrl":"https://media.baz.studio/export-masters/akqmt7a0fc.mp4","providerCostEstimateUsd":3.1405,"generationSeconds":581.562,"encodedPass":true,"reviewNote":"Frames show a clear prompt-to-code-to-video story for baz.studio. Main weakness is long sparse pauses and simple chart motion. Provisional AI frame review.","recoveryNote":null,"attemptCount":1},{"modelId":"claude-opus-4-8","displayName":"Claude Opus 4.8","provider":"anthropic","status":"incomplete","agentStatus":"failed","videoUrl":"https://media.baz.studio/export-masters/63shkhd430.mp4","providerCostEstimateUsd":1.6545,"generationSeconds":265.29,"encodedPass":true,"reviewNote":"The sampled frames show a clean prompt to code to video story for baz.studio. The main weakness is restrained motion with a possible blank transition beat. Provisional AI frame review.","recoveryNote":"The agent stopped before completing the workflow.","attemptCount":1}],"source":"september_single_trials","ranked":false,"contract":{"pipelineVersion":"motionbench-agentic-v1","prompt":"Make a 10-second launch video for baz.studio. Decide the strongest product story, create your own creative brief and execution plan, then build, review, and deliver the finished video. You are directing this - the available patterns and defaults are a toolbox, not a script; use, combine, or ignore them as your own creative judgment requires. No audio.","promptSha256":"a9b7cda9924763aee2044b037aafa9aa4f2e0982c919cb6b43c3700186186b0b","brandPackSha256":"75f639a1a443b4f8cc4b9e3520393d0ce310674f81c39daac6b8b5aa6abfa157","timeline":{"durationSeconds":10,"frameCount":300,"fps":30,"width":1920,"height":1080,"audioPolicy":"silent"}}}