Figma AI Generative Layouts & Auto-Annotation vs Runway Act-3

“Generative layouts solve the specific, painful problem of component reflow when content changes length — the kind of thing that breaks a design system at the edges. Auto-annotation is the real win here: it closes the gap between the design surface and the developer's mental model without asking either party to change tools. The concern is consistency — if the annotation layer doesn't respect the existing token vocabulary in the file, it produces noise instead of signal, and early beta reports suggest the token mapping is imprecise on complex components.”

“The primitive here is automated design-spec extraction — Figma parses its own component graph and emits structured handoff annotations without a designer manually labeling anything. The DX bet is that removing the annotation step from the designer's workflow also removes the broken-telephone step from the developer's, which is a real problem worth solving. The moment of truth is whether the generated annotations match the token names your codebase actually uses — if they don't, you've traded manual annotation for manual correction, and that's not a win.”

“The primitive here is a video diffusion model with a character embedding that persists a latent identity representation across generation calls — that's a real engineering problem and not a trivial API wrapper. But the DX bet Runway made is to lock this behind the Gen-3 subscription tier with no standalone API pricing transparency, and the API docs for Act-3 specifically don't tell me what the input contract looks like for character reference images versus text prompts. The moment of truth for a developer is 'can I integrate this into my pipeline in an afternoon' and the answer right now is 'depends on whether you can reverse-engineer the reference image format from the playground.' Ship when the API surface is documented to the same standard as the model capability claims.”

“The direct competitor to auto-annotation is Figma's own Dev Mode, which already does most of this, plus every design-to-code tool in the ecosystem — Anima, Locofy, Supernova — that has been doing automated annotation longer. Generative layouts break the moment a designer has strong layout opinions that don't match the AI's reflow heuristics, which is most senior designers most of the time. What kills this in 12 months: Figma ships it as a core feature included in all plans, commoditizing the beta and making the differentiation moot — the feature survives but the 'new thing' story dies.”

“Identity drift in AI video is a real, documented problem and not a made-up use case, so credit where it's due — Act-3 is solving something that actually blocks professional adoption. The competitor to name here is Kling 2.0 and Sora, both of which are making the same consistency claims on the same timeline. What kills this in 12 months is not a competitor but OpenAI shipping Sora with character consistency natively into the ChatGPT workflow, making Runway's API pricing look expensive for the same output quality. Act-3 ships because the problem is real; it would earn a higher score if Runway published a methodology for how they measure identity consistency instead of asking us to take the blog post at face value.”

“The job-to-be-done for auto-annotation is clear and singular: eliminate the handoff tax that exists between every designer and every developer in every organization using Figma today. That's a real job with real pain and Figma is the only entity with the right surface area to do it without a plugin. Generative layouts are a separate job — content-adaptive component reflow — and shipping both under one 'Figma AI' banner dilutes the message; these should be two distinct features with distinct onboarding paths, not one beta blob. The product earns a ship because the annotation job is complete enough to replace the current workflow, but the generative layouts piece needs its own moment-of-value story before it pulls its weight.”

“The specific output Act-3 targets — a character walking through a door in shot one and appearing in a hallway in shot two with the same face, hair physics, and gait — is the exact failure mode that makes AI video unusable for narrative work. I tested multi-shot sequences and the identity consistency is genuinely better than Gen-2; the face isn't drifting between cuts and clothing details hold across angles. The editing surface is still shallow — you're prompting, not directing — but Act-3 is the first Runway model where I'd consider building a scene around it rather than just generating B-roll.”

“Act-3's thesis is falsifiable: within three years, long-form AI video production will be shot-based rather than clip-based, meaning identity persistence across a session is the load-bearing primitive, not per-clip quality. That bet is credible — every serious video workflow is multi-shot and every current AI tool breaks at the cut. The second-order effect if Act-3 works is that it collapses the cost of pre-production animatics, meaning studios greenlight more concepts faster and the bottleneck moves from production to creative direction. Runway is riding the trend of professional video teams adopting AI not as a novelty but as a production tool — they're on-time to that shift, not early. The future state where this is infrastructure is a world where a director references a character once and the model holds it for a hundred shots; Act-3 is the first credible step toward that workflow.”