Oct 14, 2022 21:00:00

Stable Diffusion version of ``MagicPrompt'' that allows you to easily automatically create multiple prompts and spells in one go just by telling the image generation AI ``Stable Diffusion'' what you want to draw in text

In the image generation AI 'Stable Diffusion', if you want to generate an image, you need a character string called 'prompt' in advance, but this prompt does not just have to be written in text, but can be entered in a unique format or order. You will have to use services like

KREA and Lexica to examine existing prompts and combine and rewrite them. This is a web app that automatically creates a prompt to generate an image when you enter the image you want to generate in text. Even if you can't think of a good combination of strings or it's difficult to search, you can easily prepare a prompt. It is possible.

MagicPrompt Stable Diffusion - a Hugging Face Space by Gustavosta
https://huggingface.co/spaces/Gustavosta/MagicPrompt-Stable-Diffusion

Enter the content you want to generate in English in the 'Initial Text' field on the left. This time, in order to create a prompt that generates 'Illustration of a beautiful girl in white dress sitting by the window', enter 'Illustration of a beautiful girl in white dress sitting by the window' and click 'Send'.

Then, 4 patterns of prompts were displayed in 'Generated Prompts' on the left.

The created prompt is as follows.
1: Illustration of a beautiful girl in white dress sitting by the window, highly detailed face, beautifull face, beautiful detailed eyes, fantasy art, in the style of JAMES MCCARTHY, illustration, epic, fantasy, intricate, hyper detailed, artstation, concept art, smooth, sharp focus, ray tracing, vibrant, photorealistic
2: Illustration of a beautiful girl in white dress sitting by the window of a spaceship, dark atmosphere, beautiful detailed face, by Stanley Artgerm Lau, WLOP, Rossdraws, James Jean, Andrei Riabovitchev, Marc Simonetti, and Sakimichan, trending on artstation
3：Illustration of a beautiful girl in white dress sitting by the window wearing a black dress, beautifull face, by Alphonse Mucha, by artgerm, body tilted, 4k resolution, highly detailed, beautiful
4：Illustration of a beautiful girl in white dress sitting by the window of her father as a baby. She has light blue eyes, black hair and bright blue hair in a bob cut. By Makoto Shinkai, Stanley Artgerm Lau, WLOP, Rossdraws, James Jean, Andrei Riabovitchev, Marc Simonetti, krenz cushart, Sakimichan, trending on ArtStation, digital

I entered the four created prompts into

the AUTOMATIC1111 version of Stable Diffusion web UI , configured the generation settings, and clicked 'Generate' to actually generate the image. The AI models used are Stable Diffusion v1.4 (model.ckpt), Waifu-Diffusion v1.2 (wd-v1-2-full-ema.ckpt), Waifu-Diffusion v1.3 (wd-v1-3-full .ckpt), the settings are 100 generation steps, Euler a sampler, 512 x 512 pixels resolution, CFG scale 7, and 3 seed values: 1234, 56789, and 24681357.

The result of entering the first prompt is below. Although the white dress has been converted to 'white dress,' the window is drawn in the background because it reflects the element of 'sitting by the window.' However, Waifu-Diffusion v1.3 depicts a mysterious cosmic horror-like existence for some reason, giving it a somewhat horror-like finish.

For some reason, in the second prompt, a spaceship element was added without permission, saying ``sitting by the window of a spaceship,'' so everything was illustrated like a science fiction anime. Masu. The images generated by Waifu-Diffusion, which is trained using the data set of the two-dimensional illustration site Danbooru, give the impression that the degree of perfection as a two-dimensional illustration is increasing. is drawn in fine detail.

In the case generated with the third prompt, the prompt 'by

Alphonse Mucha' has a fairly strong influence.However, the picture by Stable Diffusion has a strong Mucha touch, but Waifu-Diffusion The image is quite manga-like.

Below is the image generated for the fourth prompt. ``She has light blue eyes, black hair and bright blue hair in a bob cut'' clearly reflects the specifications regarding the girl's appearance. Also, for some reason, the composition was interpreted to be that she was holding a baby, and I got the impression that it was a bit broken around the baby, but I was able to draw the ``beautiful girl in a white dress sitting by the window'' without any problems.

The Stable Diffusion version of MagicPrompt is trained with 150,000 steps and filtered using approximately 80,000 datasets, and is extracted from

Lexica.art , which shows many examples of Stable Diffusion. It was created using the data obtained. Mr. Gustavosta , the author, has already completed the ' Dall-E 2 ' version, and plans to create a Midourney version in the future, and a 'complete version' that integrates these is also in progress.