Cluean AI startup that helped develop the Stable Diffusion AI image generator, launched its first mobile app yesterday to give users access to Gen-1, its video-to-video generative AI model. The app is currently only available on iOS devices.
With the new app, users will be able to record a video from their phones and generate an AI video in minutes. They can also transform any existing video in your library using text prompts, images, or style presets.
Users can select from Runway’s list of presets, such as “Cloudscape,” or transform their video to look like claymation, charcoal sketching, watercolor art, paper origami, and more. You can also upload an image or write an idea in the text box.
The app will then generate four previews for you to select from. Once you select which one you like best, it will take a few minutes to produce the final product. We tested the app ourselves and found that it took about 60 seconds or more. Sometimes it takes two minutes to generate.
Naturally, as with any AI generator, the results are not perfect and often look distorted or weird. In general, the concept of AI video generators can seem silly and even misleading. But it’s easy to see how cool that could be as technology evolves over time.
Goal and Google Both have released text-to-video generators, which are called Make-A-Video and Image, respectively.
Regardless, we found the Runway mobile app to be easy to use and generally fun to play.
Below is an example we came up with, using a clip of Michael Scott from “The Office.” One text we entered was “realistic puppet.”
(Warning: the result is terrifying.)
We also tried “3D animation”, which turned out well.
Of course, there are a few other caveats besides glitches and warped faces.
If users want the free version, there is a limit of 525 credits and they can only upload videos that are five seconds long. Each second of a video uses 14 credits.
In the future, Runway plans to add support for longer videos, co-founder and CEO Cristóbal Valenzuela told TechCrunch. The app will continue to improve and release new features, he added.
“We are focused on improving efficiency, quality and control. In the weeks and months ahead, you’ll see all sorts of updates, from longer outings to higher-quality videos,” Valenzuela said.
Also, keep in mind that the app does not generate any nudity or copyrighted works, so you cannot create videos that imitate the popular IP style.
The new Runway mobile app has two premium plans: Standard ($143.99/year) and Pro ($344.99/year). The Standard plan gets you 625 credits per month and other premium features like 1080p video, unlimited projects, and more. The Pro plan offers 2,250 credits/month and all of Runway’s 30+ AI tools.
One month after Runway released Gen-1, which was released in February, Runway released its Gen-2 model. Arguably a step up from text-to-image models stable diffusion and DALL-E, Gen-2 is a text to video generator, so users will be able to generate videos from scratch.
Runway has slowly started rolling out access to its closed beta for Gen-2, Valenzuela told us.
The app currently supports the Gen-1 model, however Gen-2 will soon be available alongside Runway’s other AI tools, such as its picture-to-picture generator.
Runway has developed several AI-powered video editing software since its launch in 2018. The company has a variety of different tools within its web based video editorsuch as frame interpolation, background removal, blur effects, a function that cleans or removes audio, and motion tracking, among many others.
The tools have helped content creators and even movie and TV studios reduce the time spent editing and creating videos.
For example, him visual effects team behind “Everything Everywhere All at Once” used technology from Runway to help create the scene in the film where Evelyn (Michelle Yeoh) and Joy (Stephanie Hsu) are in a multiverse where they have been turned into moving rocks.
Additionally, the graphics team behind CBS’s “The Late Show with Stephen Colbert” used Runway to reduce editing hours to just five minutes. according to art director Andro Buneta.
Runway also operates Runway Studios, its entertainment and production division.
—————————————————-
Source link