In this tutorial I'm going to show you AnimateDiff, a tool that allows you to create amazing GIF animations with Stable Diffusion. The best text to video AI tool available right now.
The AnimateDiff GitHub page is a source where you can find a lot of information and examples of how the animations are supposed to look. For example, you can create realistic videos with it, or a cartoon style, at the moment the cartoon style works the best, so in this tutorial I will be showcasing on how to use that.
A good checkpoint for this cartoon style is ToonYou, you can download the latest version from the CivitAI website and install it in your Stable Diffusion models folder. Download ToonYou from the official CivitAI website.
Place this checkpoint in your Stable Diffusion models folder as shown below.
To get started, you don't need to download anything from the GitHub page. Instead, go to your Stable Diffusion extensions tab. Click on "Available", then "Load from", and search for "AnimateDiff" in the list. Click on "Install" to add the extension. If you can't find it in the search, make sure to Uncheck "Hide Extensions with tags -> Script" and it will appear.
After the extension has been installed go to the “Installed” tab and click on “Apply and restart UI”. I also recommend restarting your Stable Diffusion completely to prevent any errors from occuring.
Next we need the AnimateDiff model, this is required to use the extension, you can download this model from the Hugging Face website. Currently there are 2 models available; “mm_sd_v14.ckpt” & “mm_sd_v15.ckpt”. I’ve found that the v14 model works way better but I recommend downloading both so you can try them out yourselves.
Place these files in the following directory: "Stable Diffusion"> "Extensions"> "SD web UI animatediff"> "models".
Once you've installed the AnimateDiff extension, it will be available at the bottom of the Stable Diffusion interface. To use it, click on the "AnimatedDiff" option and the interface should fold out. Here are some settings you can configure, I will list the settings I recommend.
Don't forget to check "enable" to use the extension.
If you experience a long generating time press "Remove motion module from any memory" before generating. It's also helpful to keep the negative prompt under 75 characters. Use max 16 number of frames.
I will list the recommended settings for Stable Diffusion with the ToonYou checkpoint. You can experiment with these settings and find out what works best for you.
Just stick with the default settings for the rest of the configurations.
What I recommend before generating your GIF is to generate some images and use the seed from the image you liked the best.
Now you're ready to generate amazing animated GIFs powered by AI!
Here are some examples of GIF animations rendered using AnimateDiff with specific settings:
While the quality of the output might vary, AnimateDiff is still a powerful tool that can produce amazing animations. Try experimenting with different settings and models to achieve the best results for your projects.
AnimateDiff is primarily designed for use with Stable Diffusion, but it can also be utilized in other environments like Google Colab with some adjustments.
AnimateDiff should work on most modern computers with Stable Diffusion installed. Ensure that you have sufficient RAM and GPU capabilities for optimal performance.
To get the best results, use the recommended settings for Stable Diffusion, including the ToonYou checkpoint, a minimum of 30 steps, and a resolution of 512x512 or higher.
Yes, you can experiment with various text prompts to generate different animation outcomes. Feel free to get creative and see what works best for your desired results.
AnimateDiff can be used by users with different levels of experience. Beginners can start with default settings and gradually explore more advanced configurations as they gain familiarity with the tool.