Nov 25, 2021 20:00:00

I tried using the demo of AI 'GauGAN2' that generates a landscape image along the word by inputting only a few words

NVIDIA, a major semiconductor maker, has launched AI 'GAUGAN2' that instantly creates realistic images by simply entering short sentences such as 'sunset at a beach' and 'mountains next to a lake'. Developed by

NVIDIA Research , a research institute of NVIDIA Research. Since the demo site of GauGAN2 is also open to the public, I tried using it and checked what kind of image is generated from the explanation of just a few words.

gaugan.org/gaugan2/
http://gaugan.org/gaugan2/

NVIDIA Research's GauGAN AI Art Demo Responds to Words | NVIDIA Blog
https://blogs.nvidia.com/blog/2021/11/22/gaugan2-ai-art-demo/

GauGAN2 is an AI trained with 10 million high quality landscape images using NVIDIA's supercomputer Selene. The research team used a neural network to learn the relationship between words such as 'winter,' 'fog,' and 'rainbow,' and made it possible to generate images by inputting words.

I immediately visited the demo site to check the power of GauGAN2. The demo site has a large web page display size, so if you are using a laptop or a small screen, reducing the display size will make it easier to see.

First, check the message and terms of service at the bottom of the page, and check the box at the right end of 'Check this box if you agree to the terms and conditions described below.' Unless you check this, you will not be able to try GauGAN2 on the demo site.

Next, uncheck 'segmentation' from the 'Input utilization' item at the top of the screen, and check 'text'. Now you are ready to enter the text and have GauGAN2 generate the image.

Enter 'sunset at a beach' in the 'Input text' form at the top. And when you click the arrow button pointing to the right below ...

An image of 'Beach Sunset' was generated on the tile on the right. Although the shape of the sun is slightly distorted, the quality is almost like a photograph.

Click the dice button at the top ...

Another image generated based on the same word will be displayed randomly.

Click the thumbnail images on the upper right side ...

An image with a close image was generated.

Also, if you change the text from 'sunset at a beach' to 'watermelon at a beach' and click the arrow button ...

Although it is clearly not a watermelon, it was confirmed that the generated image has changed according to the text.

'Floating ship at a sea' looks like this.

This is 'mountain covered with snow'. It seems that images with less discomfort are generated if you do not specify small objects or artificial objects.

Also, if you click the folder icon at the bottom of the image ...

It is possible to download the generated image.

This is the image downloaded this time.

Also, if you click the arrow button pointing to the left at the top of the page ...

It is possible to copy the generated image to the canvas screen on the left. You can modify the image on the right by editing the image on the canvas.