If you are someone who has dabbled or are actively dabbling in AI Art, you must have surely heard of Stable Diffusion. One of the things that people love about Stable Diffusion is the fact that there is no censorship and people can literally create anything that fancies their imagination. Also, Stable Diffusion can be used online as well as offline, so if you have a powerful enough computer, you can run Stable Diffusion right on your computer.
Stable Diffusion has been grown over the last few months with a host of new features being introduced at regular intervals, but now, it has received a feature that will change generative AI forever. Say hello to video generation on Stable Diffusion.
Stability AI, the company behind Stable Diffusion has introduced a new utility that will generate short form video content via a text prompt given by the user. The utility has been conveniently named Stable Video Diffusion, and features two models at boot – SVD and SVD-XT. Now, both models will create 4 second videos, but the number of frames that will be processed are slightly different.
If you pick the SVD model, the clip will play for 14 frames, while the SVD-XT model takes it to 25 frames. As mentioned earlier, the video will play for 4 seconds post-render, so the length of the generated video will not matter too much for now.
Stability AI has posted a video on Youtube, showcasing the capabilities of Stable Video Diffusion, and the quality is surprisingly great. As far as the extent of motion is concerned, you are can only create a slow panning shot or a slight bobbing of the head of the subject. AI Artists have been craving an animation model on Stable Diffusion, and now that it is here, it will be interesting to see wha artists come up with this new feature.
Now, if you are intrigued by this tool, you will have to get onto a waitlist, and once you receive the invite, you can start using this tool. At the moment, you can access and read Stability AI’s white paper on this tool to see how the project came to be and what it encapsulates. The reason for the delay in deployment is that Stability AI is trying to use as many publicly accessibly video content to train their models. This is because Getty Images had sued Stability AI for using their proprietary images for training their AI Art generation tool. Stability AI want to be a bit more careful in this case.
Would you be interested in using this AI Video Generation tool? Let us know in the comments section.
