Jul 14, 2023 20:00:00

Stability AI releases 'Stable Doodle', a service that AI converts sketches drawn on the browser into images

Image generation AI such as Stable Diffusion and Midjourney can generate images by entering text and giving instructions to AI, but it is quite difficult to generate images of your choice with only text. AI research and development company Stability AI announced the launch of a free service `` Stable Doodle '' that can convert simple rough sketches into images on July 14, 2023.

ClipDrop - Stable Doodle

https://clipdrop.co/stable-doodle

Clipdrop Releases Stable Doodle — Stability AI Japan
https://ja.stability.ai/blog/clipdropstable-doodle

Have you ever had the experience of drawing a rough sketch when trying to convey an image in your head to someone else, only to find it even more difficult to understand? With Clipdrop's new feature 'Stable Doodle', that problem is solved in no time.
Clipdrop can be used immediately without registration, please try this amazing feature! … pic.twitter.com/d7OBV1yAjZ

— Stability AI Japan Official (@StabilityAI_JP) July 13, 2023

Stability AI releases Stable Doodle, a sketch-to-image tool | TechCrunch
https://techcrunch.com/2023/07/13/stability-ai-releases-stable-doodle-a-sketch-to-image-tool/

When you access Stable Doodle, the following screen will be displayed.

Stable Doodle is very easy to use. Draw a rough sketch of the target image in the white frame using a mouse or stylus pen. This time I drew a sketch of 'house with windows'.

After drawing the sketch, write a description in English in the 'Enter a prompt' field below. This time, enter 'House with a window' and click 'Generate'.

Then, three candidate images are generated and displayed.

To download the images, select each image and click 'Download' at the top right of the screen.

Also, if you click 'No Style' in the prompt column, 14 styles such as 'Photographic', 'Fantasy Art', and 'Origami' will be displayed. By selecting a style, it is possible to specify the mood of the generated image.

This time I selected 'Anime' and clicked 'Generate' again.

The generated image looks like this. A rough sketch of a house has been transformed into an anime-like image.

According to Stability AI, Stable Doodle uses

Stable Diffusion XL 's advanced image generation technology and ' T2I-Adapter ' developed by Tencent's research and development department, Tencent ARC , which enables precise control of image generation by AI. It was developed in combination.

Also, Stable Doodle uses T2I-Adapter to understand sketch outlines and generate images based on those outlines and input prompts.

Stability AI says, 'The quality of the output image depends on the complexity of the sketch and the explanation of the prompts.' ``The generated images can be used for client designs and presentations, website materials, and logo creation under the terms of use.''

Furthermore, Stability AI says, 'Stable Doodle will also support importing sketches by users in the future.'

Stable Doodle can be accessed from the official website of the AI image editing application `` ClipDrop '' acquired by Stability AI in March 2023 , as well as from the iOS version and Google Play version of ClipDrop. Although StableDoodle can be used for free, membership registration to ClipDrop is required to generate 5 or more images per hour.