Runway Gen-2: Text to Video released. Tests and impressions.

Dive into the world of AI-generated video with Runway Gen-2. Explore the initial impressions, prompt tips, and everything you need to know about this revolutionary tool.

Introduction

In the ever-evolving landscape of digital media, the advent of AI-generated video has opened up a Pandora's box of creative possibilities. One such tool that's been making waves recently is Runway's Gen-2. This AI video generator has been turning heads with its ability to transform text prompts into dynamic video sequences. But what's the real scoop on this tool? Let's dive into the nitty-gritty of Runway Gen-2 and add more white space around subjects using this innovative technology.

Runway Gen-2: A Quick Overview

Runway Gen-2 is a web-based AI video generator that allows users to create unique video content from text prompts. It's as simple as typing in a description and letting the AI work its magic. But don't be fooled by its simplicity. Underneath the hood, Gen-2 is a powerhouse of AI technology, capable of generating a wide range of video styles and sequences.

The User Interface

The user interface of Gen-2 is a study in minimalism. It features a section for writing prompts and controls for the seed number and interpolate function. The latter is a handy tool that ensures smooth transitions between frames. There's also an option to upscale the video and remove the watermark, giving your content a professional touch.

Writing Prompts: The Gen-2 Formula

When it comes to writing prompts for Gen-2, there's a bit of an art to it.

A good prompt typically includes: the style, shot, subject, action, setting, and lighting. This formula helps guide the AI in generating the desired video sequence.

For instance, a prompt could be as simple as "cinematic action sci-fi film, a marine walks down a spaceship hallway, horror film lighting." The more specific the prompt, the better the results.

Prompt Example 1: "Cinematic action sci-fi film, a marine walks down a spaceship hallway, horror film lighting."

The result:

Adding More White Space Around Subjects Using Gen-2

One of the standout features of Gen-2 is its ability to add more white space around subjects. This can be particularly useful when creating cinematic sequences or focusing on specific characters or objects in a scene. By keeping character descriptions simple and specific, you can guide Gen-2 to create more focused and visually appealing video content.

Prompt Example 2: "Skateboarding video action footage, a skater doing a kickflip, city street, sundown."

The Gen-2 Experience: Initial Impressions

So, what's it like to use Gen-2? Well, it's a bit like collaborating with a very stubborn cinematographer. The AI has its own way of interpreting prompts, which can lead to some unexpected and often strange results. While it may not always produce the exact shot you had in mind, it often comes up with something intriguing.

Prompt Example 3: "Cinematic action spy film, long shot, handsome spy in a tuxedo walks toward woman in a black dress, high-end bar, warm lighting."

Although being a new unique way of obtaining content, the AI does not produce photo-realistic content. While comparing the AI video to a Dissolve video, we noticed that the Dissolve clip looked much more authentic and just better quality. The AI appears manufactured and fake, even when using the upscaled version.

The Upscaling Difference

One of the key features of Gen-2 is its upscaling capability. This feature significantly improves the quality of the generated video, making it worth the extra investment. The difference in quality between upscaled and regular videos is quite noticeable, with upscaled videos offering a more detailed and high-definition output.

Generated video vs real footage:

Below is video that we generated using Runway for an establishing shot of a hospital.  To the right of it is real footage from Dissolve (Modern Hospital Exterior Building Timelapse Royalty-Free).  

The generated video quality is decent but is not as crisp, sharp and smooth.  It feels a bit choppy and for anyone else generating videos using Runway, it looks AI generated.

Video Tutorial

For a more in-depth look at how to use Runway Gen-2, watch their comprehensive tutorial by Theoretically Media on YouTube. Check out their YouTube channel for more insightful content on AI and digital media technologies.

FAQs

1. What is Runway Gen-2? Runway Gen-2 is an AI video generator that creates unique video content based on text prompts.

2. How does Gen-2 work? Gen-2 uses AI technology to interpret text prompts and generate corresponding video sequences.

3. What is the benefit of upscaling in Gen-2? Upscaling in Gen-2 improves the quality of the generated video, providing a more detailed and high-definition output.

4. How can I get the best results from Gen-2? To get the best results, use specific and detailed prompts. A good prompt typically includes the style, shot, subject, action, setting, and lighting.

Conclusion

In the realm of AI-generated video, Runway Gen-2 will become a game-changer. Its ability to transform text prompts into dynamic video sequences offers a new world of creative possibilities. Whether you're a filmmaker, content creator, or just a tech enthusiast, Gen-2 is a tool worth exploring.