Welcome to the realm of cutting-edge animation control! In this guide, we delve into the dynamic fusion of Motion LoRA's and the AnimateDiff extension within Stable Diffusion (A1111). Get ready to elevate your animation game with unparalleled control, all while ensuring a watermark-free final masterpiece. Let's embark on a journey to unlock the full potential of these tools and redefine the possibilities in motion design.
Before we embark on the journey of crafting watermark-free, stunning animations, certain prerequisites must be in order. Presented below is a list of the necessary requirements to get started.
The AnimateDiff extension takes the spotlight as our favored tool, streamlining the process of creating videos or GIFs. If you haven't yet installed the AnimateDiff extension and the accelerating LCM LoRA's for rendering, please consult a dedicated article linked below. It provides step-by-step instructions on downloading and installation:
In essence, acquiring a Motion LoRA is essential for maintaining control over the motion in your final animation, be it a video or GIF. Additionally, a Domain Adapter LoRA is required to create an animation without any watermark.
Acquire these Motion LoRA's directly from the Hugging Face website. All files come in Safetensor format, be sure to choose the Motion LoRA that aligns with your preferred motion style. Similar to standard LoRA's, relocate a downloaded file to the LoRa models folder located at: "stable-diffusion-webui > models > Lora."
Subsequently, download the Domain Adapter file identified as "mm_sd15_v3_adapter.safetensors" and be sure to place this LoRA also in the lora models directory: "stable-diffusion-webui > models > Lora".
Let's launch Stable Diffusion and proceed by navigating to the dropdown settings menu in the AnimateDiff extension, where we'll make the required adjustments. The specific settings are detailed below:
You can leave the remaining settings in their default state. If you seek additional information about the AnimateDiff extension, feel free to visit the AnimateDiff GitHub page.
If all configurations are correctly adjusted in the AnimateDiff Menu, let's move on by scrolling to the top. To start, we'll choose our checkpoint. In our case, aiming for a realistic video animation, we'll opt for the "Realistic Vision" checkpoint. We also employ the LCM LoRA within the prompt to enhance and expedite the rendering process.
Moving forward, let's navigate to the global settings in the "txt2img" tab, a crucial step in enhancing rendering speed when using the LCM LoRA. Here are the settings to accelerate your video generation:
After preparing your video, click "Generate," and see the Motion LoRA create a motion-controlled animation. When it's done, find your video in the "stable-diffusion-webui > outputs > txt2img-images > AnimateDiff" folder, complete with the date it was made.
For the purpose of this tutorial, we've utilized the "TiltUp" Motion LoRA. However, feel free to experiment with various Motion LoRAs to achieve different results. Particularly, trying out the "ZoomIn", ZoomOut", "PanLeft" and "PanRight"motion modules can yield incredible outcomes. So, please feel free to experiment with them. Below you will find our final result with the use different Motion LoRA's:
Congratulations on exploring the powerful combination of Motion LoRA's and the AnimateDiff extension in Stable Diffusion (A1111)! By following the steps outlined in this guide, you've learned how to achieve watermark-free, unparalleled animation control. Whether you're creating videos or GIFs, this fusion of tools opens up a realm of possibilities for elevating your motion design.
Absolutely! While we demonstrated the process using a specific Motion LoRA (TiltUp), feel free to experiment with others like "ZoomIn," "ZoomOut," "PanLeft," and "PanRight." Each Motion LoRA offers unique effects, allowing you to tailor your animations to your preferences.
The Domain Adapter file is a crucial component in animation generation within Stable Diffusion. Specifically, the "mm_sd15_v3_adapter.safetensors" file ensures that your animation is crafted without any watermark. It acts as an essential element to achieve a clean and professional final output, preserving the integrity of your animated creations.