How to Install & Use LoRA Models in Stable Diffusion

Updated
How to Install & Use LoRA Models in Stable Diffusion
Discover the creative potential of LoRA models in Stable Diffusion. Learn how to generate stunning images with specific styles and themes. Unleash your creativity today!

1. Introduction to LoRA Models

Welcome to this tutorial on how to create wonderful images using Stable Diffusion with the help of LoRA models. In this post, we will have a closer look at how we can find, install, and use these so-called LoRA models. These models are instrumental in generating images with specific styles and themes. For instance, in this post, we'll explore how to create images featuring girls wearing traditional Chinese dresses. Let's dive in!

2. Finding LoRA Models

In our previous tutorials, we went to the website called Civit AI to find checkpoint models that are required to generate the desired images. These models come in various styles and sizes, with each offering a unique output. While some models are general purpose, others are more specialized. Let's explore how to find the LoRA models that suit our needs.

  • Go to Civit AI
  • Click the filter icon on the top right of the web page
  • Select LoRA, the page now automatically refreshes and only shows LoRA models.

how-to-install-lora-models-stable-diffusion-filter.PNG

Here you can search for any LoRA model you like, I will be using the traditional chinese clothing model version 3 which can be found on Civit.ai website.

Stable Diffusion in the Cloud⚡️Run Automatic1111 in your browser in under 90 seconds
20% bonus on first deposit

3. Installing LoRA Models

Once we've identified the desired LoRA model, we need to download and install it to our Stable Diffusion setup. Download the LoRA model that you want by simply clicking the download button on the page. how-to-install-lora-models-stable-diffusion-download.PNG

Once your download is complete you want to move the downloaded file in Lora folder, this folder can be found here; stable-diffusion-webui\models\Lora

These models are relatively compact, ranging from 50 to 200 megabytes, making them disk space-efficient.

4. Using LoRA Models in Stable Diffusion

With the LoRA model successfully installed, it's time to unleash its creative potential. We'll start by generating an image without the LoRA model activated to see the default output. Then, we'll explore how to activate the LoRA model, adjust its strength, and generate images with the desired style. You'll be amazed at the transformation!

Image without LoRA how-to-install-lora-models-stable-diffusion-portrait.png

Image with LoRA how-to-install-lora-models-stable-diffusion-chinese-clothing.png To clearly show the difference I used the img2img function in Stable Diffusion.

Below is a comprehensive guide available for you to explore about img2img in stable diffusion.

How to Use img2img in Stable Diffusion (Step-by-Step)

So how exactly do we use our LoRA in Stable Diffusion?

It's not as hard as you think, just follow these easy steps.

Click on the "Show/hide extra networks button", this can be found under the Generate button. how-to-install-lora-models-stable-diffusion-show-hide-networks.PNG

Next, click on Lora how-to-install-lora-models-stable-diffusion-lora.PNG

And from here you select the LoRA you want. For this example I used “cns_dress_style3_v2”. If you don’t see your LoRA you can press refresh.

If your LoRA still doesn’t show up you have likely moved the LoRA to the wrong folder.

After you have clicked on your desired LoRA model, new text will appear in the prompt. It will look like this: how-to-install-lora-models-stable-diffusion-prompt-with-lora.PNG

The number after the colon (:) indicates the strength of the LoRA, this usually ranges from 0 to 1, however each LoRA is different and I recommend checking the desired settings of your LoRA on the Civit AI webpage where you downloaded your LoRA from, too high values can mess with the image generation.

Now you’re all set to use your new LoRA. Simply click on generate to begin! transform-images-into-stunning-ai-art-with-stable-diffusion-art-ai-art-img2img-generate.png

Stable Diffusion in the Cloud⚡️Run Automatic1111 in your browser in under 90 seconds

5. Enhancing LoRA Models with Preview Images

To further personalize and enhance the experience, we can associate an image with the LoRA model. By adding a preview image to the model, we can easily identify it in the user interface.

Simply click replace preview after you have generated an image with the LoRA. how-to-install-lora-models-stable-diffusion-no-preview-image.jpg how-to-install-lora-models-stable-diffusion-preview-image.PNG

6. Conclusion - The Power of LoRA Models in Stable Diffusion

LoRA models offer incredible creative possibilities, allowing us to generate images with specific styles, themes, and even cultural elements. By leveraging LoRA models, we can elevate our image creation process and produce stunning results. Thank you for joining us on this journey, and we hope you continue to explore and experiment with LoRA models in your Stable Diffusion endeavors. Happy creating!