Mastering Out Painting with Stable Diffusion Forge UI

today I'll discuss out painting using stable diffusion Forge UI out painting is a technique in digital art and image

editing it involves expanding the borders of an image by adding new elements to its edges essentially

revealing more of the scene Beyond its original visibility open Forge and navigate to the extension tab then click

on available and hit the load from button to load all available extensions next search for MOS moic to find the

extension named Mosaic out paint tab click on its name to open the GitHub page where you can learn more about the

extension including how to use it its parameters and examples after that click install and wait for the installation

process to complete as suggested go to the installed Tab and there click on apply and restart the UI to finalize the

installation now you'll notice a new tab called Mosaic with several options which we'll discuss shortly let's head over

over to the text to image section to give it a test I'll use a prompt describing a cute bunny in a fantasy

forest in a digital painting style with a square ratio and from the sdxl Styles extension um I'll select the digital art

style then I'll hit generate and within a few seconds I should have a lovely image of a cute bunny in the Mosaic tab

you'll find the option to input your image either by dragging and dropping it or by uploading it you can remove it by

clicking on X how however a convenient method is to rightclick on the image you want to use um select copy then hover

over the designated area in the Mosaic extension and use control+v shortcut to paste it in the direction section you

can choose the side of the image you want to expand by selecting one or more directions for example you can choose

the right side and click process Mosaic to create a mosaic that can be used later in the inpaint process if you

select left for direction it will expand the left area with a mosaic you can also select multiple directions at once

regarding the method there are two options stretch and mirror stretch stretches the selected

part of the image while mirror mirrors the image we can also choose how much to expand in a certain direction using the

horizontal and vertical expand options if I reduce the horizontal percentage you'll notice that the expanded area

becomes smaller the vertical expansion only takes effect when we go up or down of course you can easily visualize how

big or small the expanded area will be based on these settings the default value is set to 0.5 I'll choose the left

Direction and the tile options allow you to control the number of tiles as you can see you can create different Mosaic

options with different sizes which will affect how the in paint modifies the image since it looks at the Mosaic to

generate something we also have a mask overlap option you can see it better if I switch to the up Direction when the

mask overlap value is higher it overlaps more with the actual image so during in painting it will actually take a little

from the ears of the bunny if I reduce the value you'll see it will go just above the ears the default value is 0.15

so I'll stick with that for now I understand that these settings can be boring so let's dive into an actual

example of out painting suppose I want to expand the left part of the image I'll select the left Direction and

process that section perhaps I'll reduce the size to half so it's not as lengthy in the Mosaic view you can see a

pixelated version of what could be there now press the send to in paint button this will transfer it to the imageo

image section within the inpaint upload tab please note it's not the inpaint tab itself but the inpaint upload tab here

you'll find the image with the Mosaic and The Mask use these settings mask mode inpaint mask masked content

original and inpaint area set to whole picture I get better results if I activate soft in painting then switch to

resize by and it should be set to one here the Deno strength is important and should be between Z .9 and one for

better results hit generate when you're ready isn't that beautiful well we need a prompt in order to work so I'll copy

the original prompt I used and paste it into image to image now when we generate we should get a better image you can

still see a little line on the bottom part if you look carefully but you can hit generate again a few times until you

get it how you like it sometimes you can fix that line by increasing the mask blur as you you can see now the blur is

bigger it's still not perfect but you can improve it more with in paint a quick fix is to use Photoshop with the

remove tool but let me show you how you can do it in Forge go to the inpaint tab and drag your image there mask the area

you want to fix then use almost the same settings but for the inpaint area choose only masked the D strength is set to

0.6 adjust the prompt so it describes what it should be in that area then hit generate I have another tutorial that

goes into more detail about in painting on my channel the result is not bad I will change resize by to resize to a

specific size like 10,24 pixels that sometimes can help to get more details in that area but if you are still not

happy with the results and you want everything to blend better you can use image to image image however that will

also change the bunny a little and not just the mask part of the main image let's expand the right part of the image

as well I will copy the image and paste it into the Mosaic tab um for direction I am selecting right and I will increase

the size to 0.5 to see how it will work with a bigger area and when it's ready you can send it to in paint I will

adjust the prompt again and add the bunny for settings it should be whole painting resized by one and deno's

strength set to one you can try a few times probably a value of 0.9 would have worked better here but let me show you

how I improve it with image to image use this send to image button to transfer it here you can leave it um on resize by if

your video card can handle it if not just use resize 2 and input a similar proportion to your image for denoy

strength play around with the slider somewhere under 0 point VI will keep it similar to your image hit generate and

here you go a cool image that blends better let me try again to see if it still produces good results yep seems to

work fine looks kind of cool when everything is done and you are happy with the results you can make it bigger

use the send to extras tab button then I just use the do X2 upscaler with a resize value of two hit generate and it

will take a while to get a bigger image and here is the final result considering we started with a square image and we're

able to extend the background I think it did a good job you can also do out painting with Photoshop if you go to the

crop tool then where it says fill you choose the generative expand option uh you can drag and adjust with the crop

tool how you want it um you can even choose a ratio so let's go with a wide one make your composition position how

you want and where you see the transparent area that is where it will be out painted apply the crop using the

check mark button then on the properties panel you should see three versions and you can test to see which looks better

for you sometimes it gets really good results but other times not so much it depends a lot on the image you are using

you can also select only a portion of the image and then and then use a prompt to describe what you want to see in that

area for example maybe I want some flowers here this pretty much wraps up what I wanted to show you for today I

know many of you have questions about uh stable diffusion I'm doing my best to answer all the questions I can both here

on YouTube and also in the Facebook group pixaroma Community I'm not good at coding I'm a designer and in these

videos I just show you how I use it maybe it will help other people it still has a lot of technical stuff and I'm

trying to explain them the best I can with my understanding I know some of you have had some tech technical problems

with certain errors but if I haven't encountered that problem and didn't find a solution I can't help you too much on

that part as I said I'm a designer however if I can and know the answer I will just reply to you with what I think

could work and what you can try thank you for watching and have a great [Music]

day