Stability AI Unveils Stable 3D Video Model for 3D Video Rendering

Stability AI released a new 3D video rendering model called Stable Video 3D (SV3D) on Monday. The artificial intelligence (AI) model generates videos, but unlike popular video generators such as OpenAI’s Sora, Runway AI, and Pika 1.0, it does not accept text input. The main goal of SV3D is to take the input image and transform the 2D photo into an orbital 3D model. The company has released the new AI model for commercial and non-commercial use.

The announcement was made by the official Stability AI account on X (formerly known as Twitter) in a job where it says: “Today we release Stable Video 3D, a generative model based on Stable Video Diffusion. This new model advances the field of 3D technology, offering significantly improved quality and multi-view. The announcement came just a month after the AI ​​company announcement Stable Diffusion 3, which improves performance in multi-topic prompts.

The Stable Video 3D AI model is available in two different variants: SV3D_u and SV3D_p. The former is capable of generating orbital videos based on single image inputs, but it does not use camera conditioning. This means that although objects in the 2D image will be converted to 3D renderings, there will be no camera movement. The highest performing variant is SV3D_p, which supports both single frames and orbital views, which will also allow it to create fully rendered 3D videos along specified camera paths.

According to the company, the AI ​​model addresses inconsistency issues faced by older generation models such as Stable Zero123. SV3D leverages Neural Radiance Fields (NeRF) and mesh representations to improve the quality and consistency of rendered videos. “Additionally, in order to reduce the problem of embedded lighting, Stable Video 3D uses a disentangled lighting model that is optimized in conjunction with the 3D shape and texture,” Stability AI said in a detailed report. blog post.

Stable Video 3D is now available for commercial and non-commercial use. For commercial use, users will need a Stability AI subscription which starts at $20 (roughly Rs. 1650) per month for the Professional tier. For non-commercial use, users may download the model weight on Hug Face.