Do you want to take your videos to the next level without a hefty price tag? Desiring crisper visuals and smoother motion? You're in luck! This step-by-step guide will show you how to upscale your videos, amping up the frames per second for that buttery-smooth result. The best part? It won't cost you a penny, and you don’t need a NASA computer to achieve it. So, let's dive in and transform your videos effortlessly, all for free!
To upscale and increase the video's FPS we will use Stable Diffusion and Flowframes. These 2 programs are free to use and super easy to set up.
To start off our upscaling journey we will first need to transform our video into a sequence of images, for this we will use the NextView extension. Simply drag and drop your video into the “Video 2 Image Sequence” section and press “Generate Image Sequence”.
When your video has been processed you will find the Image Sequence Location at the bottom. Copy this location by clicking the copy button and then open the folder by pressing on the folder icon.
Before we start upscaling entire video, it’s crucial that we do some testing first. If you don’t, you might end up wasting a lot of time and have to restart.
I will select R-ESRGAN-4x+ since my video is realistic. (Alternatively you can download other upscale models from OpenModelDB, but I won’t go into detail on that for now.)
If your video features faces in it I highly recommend enabling CodeFormer, this is a tool for face restoration that offers a trade-off between quality and fidelity and works literal wonders when it comes to upscaling. This is also what we want to test on our single frame. Set "CodeFormer visibility" to 0,75 and "CodeFormer weight" to 0,25. Leave the rest of the settings untouched and press Generate! If you sense that the face stands out in terms of quality compared to the rest of the image, fine-tune visibility and weight settings to achieve your desired result. Keep in mind that the CodeFormer weight is reversed (0 = maximum effect, 1 = minimum effect).
More information on the other settings can be found in the FAQ.
Once you’re satisfied with the outcome of your single frame, we can begin by upscaling the entire image sequence.
Now you’re all set to Generate, this might take a while depending on the amount of frames and the speed of your GPU. So while you wait, go grab a cup of coffee. Speaking of coffee, did you know you can support us by buying us a coffee? Hosting a website isn’t cheap and we rely on your support to keep things running, you can also support us by subscribing to the Next Diffusion YouTube channel!
When the upscaling of your image sequence is complete, we can start the process of merging the individual frames back into a video. For this we will use the NextView extension once again. Head to the “NextView” tab, but this time we will use the right side of the extension; Image Sequence 2 Video. Paste the folder location with your upscaled images in the "Image Sequence Location". Next, set the Frames Per Second to match your original video, this can be found in the “Result Information” or by going to the properties of your original video and going to “Details”. Now press “Generate Video”. Congratulations! You’ve successfully upscaled your video.
After your video has been generated you can click on the folder icon to quickly locate your video.
To even further enhance our video we will boost the frames per second of our video with interpolation. To do this we will use a free program called Flowframes. You can download Flowframes for free on the official itch.io website. Once you’ve downloaded the installer, open it and select all the default options for the installation. Default > Auto-Detect > Auto-Detect > Auto-Detect > Don’t pre-install AI models > Next
After the installation has finished go to the Interpolation tab.
Leave the rest of the settings at their default values and press “Interpolate!” At the bottom left corner.
The first time interpolating your video will take a bit longer than usual, this is because Flowframes has to download the Interpolation AI first.
Take a look at the noticeable improvements in your video. The increased frames per second and enhanced details are clearly visible. See for yourself how these upgrades make a significant difference in the video quality.
In conclusion, the journey from a standard video to an upscaled masterpiece has never been more accessible. With Stable Diffusion, Flowframes, and our step-by-step guide, you've harnessed the power of AI to transform your videos, all for free. Your visuals are crisper, motion smoother, and overall quality greatly improved. The results are impressive and within reach for everyone, without the need for a high-end computer. So, go ahead and share your enhanced content with the world, knowing that you've unlocked the potential of upscaling with ease.
Interpolation is a mathematical technique used in video processing. It involves estimating new data points between existing ones. In the context of video, it means creating additional frames between two original frames. This helps increase the video's frame rate, making motion appear more fluid and realistic.
Although Deforum's interpolation works well, its built-in video upscaling feature lacks the quality and features which are available in this workflow. Here, you have control over facial restoration, a wider selection of upscale models, and size options, which Deforum falls short of providing.
While GFPGAN does an okay job at restoring face, CodeFormer is just far superior and quicker. You also have more control over the visibility and the weight of the face restoration.
No, you don't need a high-end computer. The tools mentioned in this guide are designed to be accessible, and you can achieve impressive results without the need for expensive hardware.