Prompt Editing in Stable Diffusion: Merging Images Seamlessly

Welcome to the world of Stable Diffusion and the extraordinary technique of Prompt Editing! In this fascinating realm, we delve into the art of seamlessly merging images through dynamic generation. With Prompt Editing in Stable Diffusion, you have the power to initiate sampling with one picture and effortlessly transition to something entirely different midway. Get ready to embark on a journey that unlocks unparalleled creativity and allows you to craft stunning visuals by seamlessly merging images. Let's explore the magic of Prompt Editing in Stable Diffusion.

The fundamental syntax for prompt editing involves using the following format: [from:to:when]

• from: Represents the starting text or phrase.
• to: Signifies the text you want to switch to.
• when: A numerical value that determines when the switch should happen.

Understanding [from:to:when]

Let's break down the components of prompt editing:

• from: The initial text the model will start generating.
• to: The replacement text you want the model to transition to.
• when: The step number or fraction of steps at which the switch should occur.

Using Fractions and Integers for 'when'

You can specify 'when' as either a fraction or an integer:

• If 'when' is a number between 0 and 1, it represents a fraction of the total number of steps after which the switch will occur.
• If 'when' is an integer greater than zero, it indicates the exact step number after which the switch will take place.

Alright, let's set aside the syntax and explanations for now and dive straight into some captivating examples. Get ready to witness the magic of prompt editing in action!

Let's walk through a simple example to illustrate how prompt editing works in practice. I have specified the following settings:

• Prompt: best quality, ultra high res, photorealistic, [big strawberry:skull:20] hanging from a tree
• Sampling Steps: 40
• Checkpoint/Model: reV Animated

At the beginning, the model will generate a big strawberry hanging from a tree. However, after step 20, it will switch to generating a skull hanging from a tree while continuing from where it left off with big strawberry. Some examples of how it looks:

[big strawberry:skull:0.5] should have the same effect as [big strawberry:skull:20] with a sampling step of 40. Because at 0.5x40=20 steps it should switch to generating a skull instead of a strawberry.

Now let's try the following prompt:

• Prompt: best quality, ultra high res, photorealistic, [big strawberry:skull:0.7] hanging from a tree
• Sampling Steps: 40

At the beginning, the model will generate a big strawberry hanging from a tree. However, after 70%, the model will transition to generating a skull hanging from a tree while seamlessly continuing from where it left off with the big strawberry. So we should expect more of a strawberry than a skull. An example of how this looks:

The picture above does indeed resemble more a strawberry than a skull. Now, let's venture into the realm of Additional Edit Commands. Don't worry; even if your skull is still spinning from the mind-bending creativity, we'll guide you through it with ease.

In addition to the basic prompt editing syntax, there are some additional edit commands you can use to modify the prompt.

[to:when]

This command adds the 'to' text to the prompt after a fixed number of steps, as specified by 'when'.

[from::when]

This command removes the 'from' text from the prompt after a fixed number of steps, as specified by 'when'.

With all the essential prompt editing syntaxes fresh in your mind, it's time to take a leap into the world of advanced prompt editing. Get ready to witness the true potential of this technique in action through an intriguing example!

Let's explore an advanced prompt editing example with the following fantasy-themed prompt:

• Prompt: best quality, ultra high res, (photorealistic:1.4), whimsical creature carnival, [dancing pixies:giant fire-breathing salamanders:0.5] and [glittering unicorns:playful griffins:0.6] [amidst a kaleidoscope of stars::0.4] [in a realm of enchantment:in a land of fantastical wonders:0.7], highly detailed, cinematic lighting
• Sampling Steps: 40
• Checkpoint/Model: reV Animated

In this fantastical creature carnival, we have the following prompt editing commands:

• [dancing pixies:giant fire-breathing salamanders:0.5]: At 50% of the total steps, the model will switch from depicting dancing pixies to giant fire-breathing salamanders.
• [glittering unicorns:playful griffins:0.6]: At 60% of the total steps, the model will transition from drawing glittering unicorns to playful griffins.
• [amidst a kaleidoscope of stars::0.4]: At 40% of the total steps, the model will remove the phrase "amidst a kaleidoscope of stars" from the prompt.
• [in a realm of enchantment:in a land of fantastical wonders:0.7]: At 70% of the total steps, the model will switch from generating a realm of enchantment to a land filled with fantastical wonders.

Here are some examples of the above prompt:

Immerse yourself in a world where the extraordinary is the norm, and the enchantment of mythical creatures is an everyday delight!

Note: This syntax does not work with extra networks, such as LoRA.

Prompt Editing in Stable Diffusion proves to be a captivating and powerful technique for merging images seamlessly. With a solid grasp of the essential prompt editing syntax and the knowledge of how to control the timing of image switches, you have the tools to steer the creative direction with finesse. Unleash your creativity, and let the magic of seamless image merging become an integral part of your creative toolkit. The fusion of art and technology awaits your command!