A 2D action game 'Dimension Hopper' in which Stable Diffusion automatically generates the background appears, and the creator talks behind the scenes
The game ' Dimension Hopper ', which entrusted the creation of all images such as themes and backgrounds to Stable Diffusion, an image generation AI, has appeared. Robotic engineer Benji Holson, the creator, talked about the behind-the-scenes of the production, such as how he finished the game to keep the appearance of the game.
Dimension Hopper Part 1 - by Benjie Holson
Dimension Hopper is a free-to-play game on the website. Access the link below and click 'Play Game!' to start the game.
Dimension Hopper
https://dimensionhopper.com/
You can check the gameplay video from the following. Dimension Hopper is a competitive game where you control two characters with WASD or arrow keys, collect gems that appear on the field, and earn scores. After a certain period of time, the field changes entirely, but it is said that this field was automatically generated by Stable Diffusion.
In producing Dimension Hopper, Mr. Holson first gave Stable Diffusion the following image, and based on this image, he entered a prompt and generated a new image.
The generated image looks like this. Stable Diffusion generates pixel art in the background while keeping the blocks (foundation) that were painted white in the original image.
This is the image that Mr. Holson adjusted by trial and error with prompts and settings. Pixel art with a mysterious atmosphere is generated, and the illustration color is stronger than before.
Further tweaking and generation allowed me to shade the foundation.
Mr. Holson, who felt that the background and foundation did not match, thought that ``using a model trained in pixel art is part of the problem,'' and changed it to a model based on illustrations for children. He said that he tried to generate it again. The image at that time is like this. Unlike previous images where the base was placed randomly, the base and background seem to blend well.
However, it seems that the foundation sometimes merged with the background. It is believed that this is because Stable Diffusion recognizes the base as just an 'outline' and does not recognize the concept of layers.
Therefore, Mr. Holson edits so that the base has depth.
With just the above edits, Stable Diffusion was able to easily generate an image with the foundation as the foundation.
Mr. Holson noticed that the quality of the image generated by the original image changed greatly, and color-coded the original image such as 'gray', 'dark gray' and 'black'.
By giving hints such as ``gray is the base'' and ``dark gray is just a background that has nothing to do with gameplay,'' we succeeded in generating high-quality images with greater depth.
Related Posts:
