Video to prompt: a shot-by-shot workflow

Video to prompt: a shot-by-shot workflow. Explore the evidence, practical workflow and limitations with rea-video.

Video-to-prompt work translates visible evidence into a production description. It does not recover the creator’s original prompt. First establish how a shot was made, then choose a generation or reconstruction route.

Start with individual shots

Do not compress a mixed-production video into one prompt. For each cut, record subject, setting, framing, movement, lighting and text layers. Flag real screen recordings separately.

Turn observations into instructions

Subject and setting: what is in the frame?
Camera: framing, angle, movement
Action: start → change → end
Light and color: observable characteristics
Assets: files the user must supply
Post: captions, sound effects, transitions

Test one shot first

Test composition, movement and pacing on one representative shot. Text and interfaces often belong in code or post-production. A longer prompt is not automatically a better fix for a failed generation.

See a code-and-recording breakdown ↗