How to Create Morphing Animations in Stable Diffusion

Welcome to the realm of visual enchantment! In this guide, we will delve into the fascinating world of morphing animations, where artistry meets technology. Uniting the concept of stable diffusion with the captivating Loopback Wave Script, we embark on a journey to create animations that seamlessly transform and captivate. Join us as we unravel the intricacies, step by step, and unleash your creativity in crafting mesmerizing animations within the realm of stable diffusion.

Before we start making a morphing animation using stable diffusion, make sure you've got the loopback wave script and ffmpeg tool installed. These are key to creating your animations smoothly.

Step 1: Download Loopback Wave Script

• Go to the offical Stable Diffusion Loopback Wave Script website.
• Right Click on the Script file and click "Save Link As".
• Place the script in your Stable Diffusion scripts directory, as demonstrated below, and give it an appropriate name ( we named it "looback_wave")

Step 2: Download & Install FFmpeg

Converting the produced images into video format requires the use of FFmpeg, a robust multimedia framework known for its versatility. FFmpeg not only compresses videos effectively but also shines in various multimedia tasks. If you haven't set up FFmpeg, no need to stress. Just follow the easy guide below to install and set it up without a hitch.

How to Install FFmpeg on Windows 11 for Stable Diffusion

Let's take the next step by preparing a small set of images that will serve as the transformation points for our final video. In this process, we'll gather and arrange a sequence of 5 images. It's important to note that for the loopback wave script to function accurately, we'll require the initial seed image as a reference point. This seed image plays a pivotal role in guiding the morphing process effectively.

Displayed below are the images we have set up for use in our morphing video:

Image 1:

• Checkpoint: RevAnimated
• Prompt: Hypnotic illustration of bear in forest, fantasy bear, trippy art, hypnotic psychedelic, pop surrealism, dark glow neon paint, mystical, starlight, front view, (frontview:1.3)
• Sampling Method: DDIM
• Sampling Steps: 20
• Resolution: 744x416
• Seed: 1018357659

Image 2:

• Checkpoint: RevAnimated
• Prompt: Hypnotic illustration of wolf in forest, fantasy wolf, trippy art, hypnotic psychedelic, pop surrealism, dark glow neon paint, mystical, starlight, front view, (frontview:1.3)
• Sampling Method: DDIM
• Sampling Steps: 20
• Resolution: 744x416
• Seed: 1586478990

Image 3:

• Checkpoint: RevAnimated
• Prompt: Hypnotic illustration of elephant in forest, fantasy elephant, trippy art, hypnotic psychedelic, pop surrealism, dark glow neon paint, mystical, starlight, front view, (frontview:1.3)
• Sampling Method: DDIM
• Sampling Steps: 20
• Resolution: 744x416
• Seed: 3429911444

Image 4:

• Checkpoint: RevAnimated
• Prompt: Hypnotic illustration of eagle in forest, fantasy eagle, trippy art, hypnotic psychedelic, pop surrealism, dark glow neon paint, mystical, starlight, front view, (frontview:1.3)
• Sampling Method: DDIM
• Sampling Steps: 20
• Resolution: 744x416
• Seed: 582106638

Image 5:

• Checkpoint: RevAnimated
• Prompt: Hypnotic illustration of owl in forest, fantasy owl, trippy art, hypnotic psychedelic, pop surrealism, dark glow neon paint, mystical, starlight, front view, (frontview:1.3)
• Sampling Method: DDIM
• Sampling Steps: 20
• Resolution: 744x416
• Seed: 781471343

With the images now set up alongside their corresponding seed numbers, we can move forward to the next stage: the "img2img" tab.

Let's head over to the stable diffusion interface and locate the img2img tab. There, we'll initiate the process by dragging and dropping our first image. Additionally, we'll include both a positive and a negative prompt.

Img2img Settings:

Stay in sync with our configurations as we strongly advise opting for the DPM++ 2M SDE Karras as the sampling method. This choice prevents the gradual fading of the background. Equally important is the Denoising Strength factor, which should be maintained at 0.3.

Settings are listed below:

• Checkpoint: RevAnimated
• Sampling Method: DPM++ 2M SDE Karras
• Sampling Steps: 30
• Restore Faces: "Enabled"
• Resolution: 744x416
• CFG Scale: 7
• Denoising strength: 0,3
• Seed: -1

Once the img2img settings are configured, we can proceed to the subsequent stage: the Loopback Wave Script settings.

Scroll Down and choose the loopback wave script from the available options in the script dropdown. Then, follow the provided instructions to adjust the necessary settings and achieve a visually appealing morphing animation.

Basic Settings:

Let's begin by focusing on the fundamental settings within the Loopback Wave script. These include the frames, frames per wave, and the maximum additional denoise parameters. With 5 images in preparation, we'll adjust the frames per wave to 20, resulting in a cumulative total of 100 frames. Basic Settings down below:

• Frames: 100
• Frames Per Wave: 20
• Max additional denoise: 0,7

Prompt Changes:

We've arrived at the input field for prompt changes in the Loopback Wave script. In this section, you have the opportunity to finely adjust modifications at particular timeframes. This involves making corresponding prompt changes, all contributing to achieving a seamlessly morphing effect.

Here's how the prompt change operates in the following format with "::" in between: frame number::seed number::prompt, explanation down below:

• Frame: The frame number at which the transition to the next image's morphing takes place.
• Seed Number: The seed number linked to the image we've prepared for the morphing process.
• Prompt: The prompt linked to the prepared image.

Down below, we will demonstrate the accurate configuration for the prompt change input field:

Video Settings:

Pick a fitting title for your video, such as "Morph Animation," and proceed with the settings provided below:

• Frames per second: 10
• Video Quality (crf): 40
• Video encoding: VP9 (WebM)

Generate Morphing Video:

Once all the settings are configured, simply click the "Generate" button, then sit back and unwind while your captivating morph animation takes shape.

Morphing Video Output Location:

After the entire procedure concludes, you can discover the resulting video in the subsequent directory: stable-diffusion-webui > outputs > img2img-images > loopbackwave.

Inside this folder, you'll come across a folder of all the generated images, a webm format video file, and a text file encompassing your settings and prompt details.

Just give a double-click to the video file, and brace yourself for the breathtaking morphing video that you've crafted.

Below, you'll find the flawlessly morphed video we've crafted from the provided images.

In summary, we've collaboratively created a remarkable morphing video/animation employing Stable Diffusion and the Loopback Wave script. We hope you've thoroughly enjoyed the experience of crafting this morph animation with us. We're excited about the prospect of having you join us in our forthcoming tutorials!