Mastering Prompting in Stable Diffusion: Tips and Tricks

hey today I want to show you how I prompt in stable diffusion how I think about it when prompting and what methods

I use to create prompts faster I'm using stable diffusion Forge UI and Juggernaut XL version 10 model but you can use any

model you prefer with the settings that work best for that model many beginners simply prompt something simple like

portrait of a woman while many short prompts still work in interfaces like Focus or AI like mid journey and chat

GPT you're leaving too much freedom to the AI you can be more specific to get

something closer to what you have in mind for example you can specify the type of image you want such as a photo

illustration painting and so on as you can see even by mentioning photo the possibilities are still too many I got a

vintage photo so maybe you can add an extra word like modern to specify that you want a modern photo instead of a

vintage one to experiment better with the prompt you can use a fixed seed you can either use the last seed or just

type number and generate again so we have the type of image and a subject but let's also place the subject in an

environment maybe we can put her in the forest or on a beach or perhaps we want a studio photo with a black background

behind maybe I don't want the woman to have a random hair color so I add blonde hair in the prompt perhaps I want her

shirt to always be white so it stands out against the black background maybe I want the image to pop out more so I can

add a rim light coming from behind visible in the hair alternatively I might want a golden hour type of light

to make it look more natural if you have a specific hairstyle in mind you can add that to the prompt if you don't know the

name you can search on Google for hairstyles women names for example if you like bangs you can add that to the

prompt Additionally you can use chat GPT to provide lists for anything such as a list of women's clothing so I can use

like a red cardigan instead of a white shirt let's try different types of art styles for the photo instead of just

saying painting portrait which is a broad category we can specify further for example it could be an oil painting

maybe with an old look or perhaps it's a watercolor painting we could also consider a pencil drawing but in this

case we'd need to adapt the colors and background to match that style uh let's play around more with photography a

cinematic fashion portrait could look cool we can also mention the nationality of

the woman or the country for instance we could generate in African woman or a police woman since we've been so

specific with clothes it might not include the police uniform so instead of a cardigan let's add a police suit or

uniform let me quickly show you the negative prompt here you list things that you don't want to appear in your

image it doesn't work perfectly some words are stronger than others but for example if you don't want a police badge

you can add that to the negative prompt now when I generate again the badge is gone if you don't like the blue light

behind you can add it to the negative prompt if that doesn't work you can try different seeds um in the worst case

scenario you can use in painting to remove it let me remove the negative prompt and I'll show you how you can

replace different words in the prompt scroll down and go to the XYZ plot on the X Type search for prompt Sr on the X

values you put the words you want to search and replace first so for example I want to search for the word blonde and

replace it with different colors like dark purple red and so on this way you can see how the girl looks with

different hair colors as you can see now it started to generate the policewoman with different hair colors as a bonus at

the end you have a grid with the searched word and all the other variation words that were replaced you

can open it and see how they look in different colors let me dress her in a white shirt

real quick let's say I want to redo everything but the girl's face to be more similar between Generations one

thing that helps is to give her a name I usually use a random invented name but you can also use a mix of celebrities if

you want so I'll give you a name and I'll generate again with that search and replace script active as you can see in

the results the woman is quite similar between Generations because it has the same seed

and the same description and name only the color is different let's say you like the results of a prompt but you

just want a very subtle variation of it you can do that by adjusting the sampling steps or CFG scale you can do

that automatically if you go back to the scripts and instead of prompt search and replace you choose CFG scale for the X

values you can put between five and seven for example now when you generate you'll get those very subtle variations

they might be harder to see on the screen but let's go to the folder where they were saved and switch from one to

another as you can see some don't have badges or the light is a little different so you can choose the best one

from all or you can combine them in Photoshop and keep what is best from each I also like to get variations for

prompts using chat GPT so I have this prompt that I know works okay and I want a prompt adapted from different

jobs I can ask GPT to adapt it for me and as you can see I get some nice variations let me test quickly the

doctor prompt as you can see it added a white coat to the prompt now let's see how it looks like as a chef copy and

paste The Prompt using the control plus C and Control Plus V shortcuts and generate quickly different variations

sometimes I'm too lazy to write descriptive prompts so I just ask chat GPT to write it for me you just need to

guide it a little in the right direction let's test it really quick to see what we get seems to work okay go to image to

image and let me show you another trick that you can use when you don't know how to prompt but you have a photo or an

illustration upload it here and then click on the paperclip icon that will interrogate clip which stands for

contrastive language image pre-training the first time you're using it it will take some time to download a model you

can see when it's ready in the command window but after that it should interrogate quicker that will give you a

prompt for that image I'll copy this prompt and test it quickly the result is not bad could be better you can see that

it's a policewoman but she doesn't look very similar to my image what seems to work better and get more consistent

results for me is chat GPT I just upload a photo to chat GPT and ask it to describe it for me in a long sentence

let's copy The Prompt and test it to see what we get now look at that how similar the photos look like with the image I

gave it now you can talk with chat GPT to change the prompt how you want it for example

you can adapt it for a doctor instead and this is the result if you don't have access to GPT or the internet and you

still have problems with uh prompting but want to get some nice generation you can use art styles instead so if you

have a short prompt you can go to art styles and either save your own art styles or download some free art styles

from the internet I have an entire video with with 260 art styles and how to download them if you look at the prompt

description then you look at the info for Generation you can see that you get the original prompt first then the art

style is just another already saved prompt that is added to the original prompt plus the negative prompt let's

talk a little bit about how to add more weight to certain words I have this prompt where I added green blue house

next to each other to show you how I can make one word more important than the other so this is what I get for this

prompt the house has blue and green in it I can make the words Blue House more important if I add round brackets you

can see if you forgot to close a bracket it shows in red in the corner where the tokens are once I generate you can see

the house has more blue than green you can add even more weight to those words if you add another

bracket but there's an easier way to do this faster you just select the words then press control and use the up Arrow

key to add more weight with control and the down arrow you can reduce the weight it can also

have a negative value if you want it to be less important to change the value you select only the text without the

brackets and numbers and use the shortcut again alternatively you can just change the numbers manually you

should avoid going too high usually if you go more than 1.9 or two values it starts to go a little crazy and you get

something like this like an a I exploded brain if I add a negative value to The Gnome for example it will be less

important and you can see in the results that it's barely visible the main subject becomes the

house here's how I usually prompt I put the art style or medium either first or last then comes the subject followed by

the description then the environment and finally any extra information like colors lighting and mood while I was

working on the video chat GPT released a new model version GPT 40 so now it's even easier to just ask for a stable

diffusion prompt for what you want to create so if I want a watercolor painting of a cute bunny with glasses I

can get a prompt quickly now I can test it in stable diffusion and the result is what I asked for I can then make more

changes for example I can ask chat GPT to make it more minimalist and add a white background so now when I test it I

get a nice cute cartoon bunny on a white background another thing you can do is to turn on generate Forever by right

clicking on the generate button and choosing generate forever to stop it you need to

rightclick again and choose cancel generate forever if you don't want to let it generate forever and have a

specific number of generations in mind like between one and 100 you can move the batch slider to the value you want

and it will generate that number of images alternatively if you have multiple different prompts you can

choose prompts from a file or a text box you can paste prompts here or upload a text file with the prompts just make

sure each prompt is on a separate line um I can once again use chat GPT to give me a list of different variations of the

prompt with different animals then I can uh copy and paste that list of prompts in the text area when I hit generate it

will start generating each of those prompts um as you can see I get different animals on a white background

if you have any questions you can post them in my Facebook group pix Roma Community I usually post news prompts

daily challenges design and crafts there I've recently passed 1,000 members so thank you to all who joined if you found

something useful in this video leave a like thank you and have a great day