Draw It, Animate It: AI Video Generation Arrives

Runway has launched Motion Sketch, an innovative AI feature designed to transform simple doodles into animated videos. This tool allows users to draw directly onto still images, and with the assistance of AI, generate dynamic video content. For instance, a user can start with a generated image, add rudimentary sketches of movement, and the AI interprets these to create animation.

While the feature is still evolving and may require iterative prompting for precise results, it represents a significant advancement in AI-generated video. Product Manager Aditi Poduval highlights its utility in achieving specific movements without complex written prompts, appealing to visual thinkers in creative fields.

Experiments with Motion Sketch have yielded surreal and sometimes unexpected results, such as a snake animation that produced duplicate bodies or sprouted legs. These glitches, however, are often attributed to the complexity of the requested motion or misinterpretation of directional cues. The tool has shown promise in animating actual photographs by interpreting simple icons, like a fire symbol, into realistic visual effects.