The creator of ControlNet has released a generative AI tool called 'IC-Light' that can seamlessly change the background of an image by specifying a light source, so I tried using it.
GitHub - lllyasviel/IC-Light: More relighting!
https://github.com/lllyasviel/IC-Light
IC-Light is an AI tool that allows you to replace the background of an image with something else while specifying the type and position of the light source. IC-Light can be installed locally and used. In addition, a demo site was also available that can be used without installation, so I actually tried processing an image using IC-Light on the demo site.
The IC-Light demo site can be accessed by clicking the link below.
IC Light - a Hugging Face Space by lllyasviel
https://huggingface.co/spaces/lllyasviel/IC-Light
The layout of the demo site is as follows: Input the original image in the image input field at the top left, specify the background and light source of the image at the bottom left, and the image will be output on the right.
This time, we will input the image below and generate an image with the composition 'the sun setting on the beach, illuminated by sunlight from the left side.'
First, drag and drop the original image into the image input area.
Next, enter 'text describing the background and type of light source' in the prompt input area, select the direction of the light source, and then click 'Relight'. In this case, enter 'beautiful girl, detailed face, sunset over sea', select 'Left Light' as the light source direction, and then click 'Relight'.
The generated result looks like this. Two images were output: 'an image with the background of the original image cut out' and 'an image with the background replaced while taking into account the light source instructions.' If you check the generated image, you can see that it expresses the sunlight shining from the left side as instructed.
I was curious to see what would happen if I changed the direction of the light source, so I left the prompt as it was and changed the light source direction to 'Right Light' and clicked 'Relight'.
The result is below. The sun has moved to the right. The character's hair and shadows have also changed to match the direction of the light source.
This time, change the prompt to 'beautiful girl, detailed face, white LED, data center', change the light source direction to 'Top Light' and click 'Relight'.
The generated result looks like this. If you replace only the background with something else, the subject tends to stand out, but if you use IC-Light, the depiction of the subject changes according to the light source, so you can replace the background naturally.
Related Posts:
in Review, Software, Web Application, Art, Posted by log1o_hf