Create Morph Animations using Frame Interpolation in Stable Diffusion (A1111)

Updated
Create Morph Animations using Frame Interpolation in Stable Diffusion (A1111)
Effortlessly master morph animations with the AnimateDiff Extension (A1111) and the application of frame interpolation. Explore the skill of seamlessly transforming an image sequence into captivating morph animations.

1. Introduction

Welcome to a realm of boundless creativity! Join us on a journey where innovation converges with seamless morph transformations. With the AnimateDiff Extension (A1111) as your ally, we invite you to effortlessly navigate the intricate world of morphing, unveiling the techniques to create visually captivating experiences. Let's embark on this exploration together and breathe life into your visuals with the transformative power of AnimateDiff Extension (A1111).

2. Requirements for Morphing Animations with AnimateDiff Extension

Before we explore the intricacies of crafting captivating morph animations, it's essential to verify that specific prerequisites are met. Here, you'll discover a compilation of the fundamental requirements to initiate our journey into the world of morphing.

Requirement 1: AnimateDiff Extension

The AnimateDiff extension takes the spotlight as our favored tool, streamlining the creation of videos or GIFs effortlessly. If you haven't yet installed the AnimateDiff extension, please consult a dedicated article linked below. It provides step-by-step instructions for downloading and installation:

Fast Video Generation with AnimateDiff & LCM LoRA's (A1111)

Note: To produce a morph animation, we’ll interpolate between frames with Deforum's FILM implementation. To enable this option, it’s essential to have Deforum installed. Navigate to the Extensions tab, choose Available, find deforum in the list of available extensions and install it. Restart A1111 once the extension has been installed.

Requirement 2: Image Sequence

Ensure you have prepared images you wish to morph and placed them within a folder named of your choosing. We've arranged a folder named "Image_Sequence" in the C drive, depicted below, housing 25 images designated for our morphing animation.

create-morph-animations-using-frame-interpolation-in-stable-diffusion-a1111-requirement-2-image-sequence-preperation.webp Note: Feel free to assign numerical names to the images in the folder to create a structured order for the final morph animation.

Stable Diffusion in the Cloud⚡️Run Automatic1111 in your browser in under 90 seconds
20% bonus on first deposit

3. Img2img Settings (Stable Diffusion)

Once the prerequisites are in place, proceed by launching the Stable Diffusion UI and navigating to the "img2img" tab.

Img2img Batch Settings

  • Access the "Batch" subtab under the "img2img" tab.
  • Enter the file address of the image sequence into the "Input directory" text field.
  • In our case, the file address for all the images is "C:\Image_Sequence".

how-to-create-morph-animations-with-animatediff-extension-a1111-img2img-batch-file-location-image-sequence.webp

Img2img Global Settings

Scroll down and proceed by choosing the designated settings. It's important to mention that we will set the denoising strength to 0 to maintain the integrity of the images in our final morphing animations. When the denoising strength is set to 0, many settings, such as the checkpoint, prompt, negative prompt, sampling method, and sampling steps, won't have any effect. Please keep this in mind, the majority of the settings mentioned here won't affect the outcome since the denoising strength is set to 0. We'll include them for reference purposes:

how-to-create-morph-animations-with-animatediff-extension-a1111-global-img2img-settings-denoising.webp

  • Sampling Method: LCM
  • Sampling Steps: 8
  • Width & Height: 360 x 640 (9:16 Ratio)
  • CFG Scale: 2
  • Denoising Strenght: 0
  • Seed: -1

4. AnimateDiff Settings (Frame Interpolation)

Let's continue by opening the dropdown settings menu in the AnimateDiff extension and making the required adjustments. The detailed settings are provided below:

create-morph-animations-using-frame-interpolation-in-stable-diffusion-a1111-animatediff-settings-frame-interpolation-video-gif.webp

  • Select the motion module named "v3_sd15_mm.ckpt"
  • Set the save format to "MP4" & "GIF"
  • Enable the AnimateDiff extension.
  • Number of Frames: 25 (Provide the total number of images you have prepared; in our case, this amounts to 25 images).
  • Frames per Second (FPS): 24
  • Frame Interpolation: FILM
  • Interp X: 20 (A higher numerical value will result in the generation of more frames between each image in the sequence).
  • For a more thorough understanding of the AnimateDiff extensions, it is advisable to explore the official AnimateDiff GitHub page.

Note: We'll be utilizing the "FILM" option in the Frame Interpolation settings. Ensure that you have installed the "Deforum" Extension to enable this functionality.

Stable Diffusion in the Cloud⚡️Run Automatic1111 in your browser in under 90 seconds

5. Example & File Location (Morphed Animation)

Once the settings are appropriately configured, you can click on the "Generate" button. After the rendering process is complete, you'll locate your final morphed animation in MP4 and GIF format in the specified directory: "stable-diffusion-webui > outputs > img2img-images > AnimateDiff > [Correct_Date]".

create-morph-animations-using-frame-interpolation-in-stable-diffusion-a1111-morphing-animations-file-location.webp

Let's examine the generated morph animation. Feel free to experiment with various image sequences to achieve different results.

6. Conclusion

Embark on a journey of limitless creativity with the AnimateDiff Extension (A1111) and delve into the art of seamlessly transforming images for captivating visual experiences. By following the steps outlined in this guide, you can effortlessly master the creation of morph animations, breathing life into your visuals with the transformative power of AnimateDiff.

Frequently Asked Questions

To use the FILM option, navigate to the AnimateDiff settings, specifically the Frame Interpolation settings, and select FILM. Ensure you have installed the Deforum Extension for this functionality to work.

When the denoising strength is set to 0, it ensures that the images within the image sequence remain unaltered in the final morphing animations. This setting prevents most other parameters, such as checkpoint, prompt, negative prompt, sampling method, and sampling steps, from influencing the outcome.

While it's technically possible, it's recommended to use images with consistent dimensions in the same sequence. Morphing images with different sizes may lead to distortion or unexpected results in the final animation.

If an error occurs, double-check your settings and ensure that all prerequisites, including installed extensions and properly prepared image sequences, are in place. Review any error messages for specific details and refer to the documentation for assistance in troubleshooting.