Outfit Changes with Stable Diffusion and ControlNet (OpenPose)

Step into a realm where fashion encounters the future. Envision the fusion of fashion and cutting-edge technology, including Stable Diffusion and Inpainting. This occasion is dedicated to exploring the boundaries of transforming character outfits within your images. Prepare to witness the synergy of creativity and technology shaping the upcoming fashion landscape. Come along on this voyage of innovation and style!

Requirement 1: Stable Diffusion

To begin our inpaint fashion and clothing show smoothly, it's necessary to have Stable Diffusion installed. If you haven't set it up already, no need to worry. We've created a clear installation guide on how to install stable diffusion on windows

Requirement 2: ControlNet & OpenPose Model

Upon successfully downloading and installing Stable diffusion, it is essential to also have ControlNet installed. We will use ControlNet for managing the posture of our fashion model. Additionally, downloading the OpenPose model is necessary. To assist you further, we provide an installation guide for ControlNet down below:

How to Install ControlNet Extension in Stable Diffusion (A1111)

Requirement 3: Initial Image

Ensure that you have an initial image prepared, or alternatively, you can generate one directly within the txt2img tab, If you have an image ready, we can move forward to the img2img tab. To kickstart our creative process, We will start off with the following image below:

Please proceed to the "img2img" tab within the stable diffusion interface and then proceed to choose the "Inpaint" sub tab from the available options.

1. Open Stable Diffusion interface.
2. Locate and click on the "img2img" tab.
3. Among the available tabs, identify and select the "Inpaint" sub tab.

Commence by positioning the initial image onto the canvas. Following this step, apply inpainting to modify the body and clothing components, yielding an image resembling the following:

Inpaint Settings (img2img)

To achieve the desired outcome, follow these steps within the inpaint settings:

• Resize mode: Just Resize
• Mask blur : 4
• Mask Mode: Inpaint Masked
• Masked Content: original
• Inpaint Area: Whole Picture
• Sampling method: Euler a (This choice helps maintain image clarity)
• Sampling Steps: 30
• Match the width and height ratio with the original image for accurate proportions.
• CFG scale: 7
• Denoising strength: 0.75
• Seed: -1

ControlNet Settings (OpenPose)

Scroll down the page and access the ControlNet panel. Inside, opt for the subsequent configurations:

• "Enable" ControlNet
• Select "Pixel Perfect"
• Control Weight: 1
• Control Mode: Balanced

Having established all the necessary configurations accurately, it's time to proceed to the subsequent phase. We will select the cyberrealistic checkpoint and formulate an affirmative prompt to alter the character's outfit. Additionally, we will devise an opposing negative prompt. Once all the remaining settings are in order, we can simply click "Generate" and observe the creation of some stunning outfit transformations.

This is where we'll display the changes made to the clothing of the attractive fashion model. Additionally, we'll include the postie and negative prompts that are used to make the outfit changes in the final inpainted image.

Sporty Style

• Positive Prompt: Latina woman, sportive style, sport outfit, sport wear, sport clothes, (black yoga pants:1.3), sneakers
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

Casual Style

• Positive Prompt: Relaxed Latina woman, comfortable clothing, casual clothes, casual, jeans, pants, t shirt, shirt
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

Bohemian Style

• Positive Prompt: Vibrant Latina woman, flowing patterns, bohemian setting, free-spirited style
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

Classy Style

• Positive Prompt: Latina woman, sophisticated attire, elegant setting, classy style
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

Summer Style

• Positive Prompt: Latina, women, summer dress, dress, summer dress, beach dress, summer vibes, flower
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

Gothic Style

• Positive Prompt: Latina, gothic style, catwalk, gothic outfit, black outfit, gothic fashion
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark,(blurry), (((strabismus))), (wrong finger), multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark, NG_DeepNegative_V1_75T, shadow, sunlight, bad hands

In concluding our process, we've harnessed the power of Stable Diffusion through the inpainting tab, coupled with ControlNet and OpenPose, to maintain precise character poses. This synergy has allowed us to effortlessly accomplish clothing changes, simplifying the transformation.

Yet, if you aspire to elevate your clothing style even more, an additional level of enhancement is attainable. To achieve this, download and use Loras to elevate your outfit changes. We have an tutorial on how to download and use Loras.

We believe that this journey through clothing swaps has provided you with an enjoyable experience. We hope you found this tutorial to your liking, and we look forward to seeing you in the next one.