Runway releases video generation AI model 'Gen-3 Alpha,' making 5-10 second videos available to anyone within days



AI company Runway has announced Gen-3 Alpha , a new video generation AI model trained on new infrastructure built for large-scale multi-modal training.

Introducing Gen-3 Alpha: A New Frontier for Video Generation
https://runwayml.com/blog/introducing-gen-3-alpha/

Runway unveils new hyper-realistic AI video model Gen-3 Alpha | VentureBeat
https://venturebeat.com/ai/runway-unveils-new-hyper-realistic-ai-video-model-gen-3-alpha-capable-of-10-second-long-clips/

Gen-3 Alpha is an AI model capable of generating videos with complex scene changes, a wide range of cinematic options, and detailed art direction capabilities.



Runway described Gen-3 Alpha as 'the first in a series of upcoming AI models that Runway will train on infrastructure built for large-scale multi-modal training and marks an important step in Runway's goal of building general-world models.'

The video attached to the post below was generated from the prompt, 'Subtle reflections of a woman on the window of a train moving at hyper-speed in a Japanese city.'




Gen-3 Alpha is trained on both video and images, so it can not only generate video from text, but also generate video from images and images from text. In addition, control functions such as motion brushes, advanced camera control functions, and director tools will be enhanced in the future. Gen-3 Alpha will be released with new safety measures such as the new and improved Runway visual moderation system and C2PA , a standard for proving the authenticity of digital content.

The video attached to the post below was generated from the prompt, 'An astronaut running through an alley in Rio de Janeiro.'




Runway highlights that Gen-3 Alpha is a thoroughly trained video-generative AI model for creative applications, and is the collaborative effort of a multidisciplinary team of research scientists, engineers and artists.

The video attached to the post below was generated with the prompt 'FPV moving through a forest to an abandoned house to ocean waves.'




Runway is also working with and partnering with major entertainment and media companies to develop custom versions of the Gen-3 Alpha, which will be part of the Gen-3 model family, to enable more stylized and consistent character generation and to target specific artistic and narrative requirements.

The video attached to the post below was generated from the prompt, 'An older man playing piano, lit from the side.'




Runway said of Gen-3 Alpha, 'This technological breakthrough marks an important milestone in our efforts to empower artists and pave the way for the next generation of creative and artistic innovation.' Gen-3 Alpha will be available to everyone within the next few days.

The video attached to the post below was generated from the prompt, 'A slow cinematic push in on an ostrich standing in a 1980s kitchen.'




The video attached to the post below was generated from the prompt, 'A middle-aged sad bald man becomes happy as a wig of curly hair and sunglasses fall suddenly on his head.'




The video attached to the post below was generated from the prompt, 'A colossal statue of an ancient warrior stands tall on a cliff's edge. The camera circles slowly, capturing the warrior's silhouette.'




The video attached to the post below was generated from the prompt, 'An empty warehouse, zoom in into a wonderful jungle that emerges from the ground.'




The video attached to the post below was generated from the prompt, 'Handheld camera moving fast, flashlight light, in a white old wall in an old alley at night a black graffiti that spells 'Runway'.'




According to technology media VentureBeat, the first release of Gen-3 Alpha will enable users to generate 5-10 second videos. It will take 45 seconds to generate a 5 second video, and 90 seconds to generate a 10 second video. Runway explains that Gen-3 Alpha will be available to everyone in the next few days, but according to information obtained by VentureBeat in an interview with the company's CTO, Anastasis Germanidis, Gen-3 Alpha will first be available to Runway paid subscription users.

It is not clear what was used for the training data of Gen 3-Alpha, but VentureBeat points out that 'Most of the major AI generative models do not disclose in detail what data they use for training. It is unclear whether the data was procured through a paid license agreement or scraped from the Internet.' VentureBeat asked Runway about the training data of Gen-3 Alpha, but the response was vague: 'We have an in-house research team that oversees all training, and we train the models using carefully selected in-house data sets.'

Related Posts:

in Software,   Video, Posted by logu_ii