'MiraGe' is an editing technique that allows you to put 2D images into 3D space and 'edit without physical discomfort'
Generative AI makes it possible to perform editing tasks such as 'moving objects within an image' and 'creating animations from a single image,' but it often produces results that are physically impossible. MiraGe , an image editing method developed by a research team from Jagiellonian University and Cambridge University, enables physically correct editing by 'dropping images into three-dimensional space.'
[2410.01521] MiraGe: Editable 2D Images using Gaussian Splatting
MiraGe
https://waczjoan.github.io/MiraGe/
Image Editing with Gaussian Splatting - Unite.AI
https://www.unite.ai/image-editing-with-gaussian-splatting/
MiraGe uses a technique called ' Gaussian Splatting ' to place an image into a three-dimensional space, allowing you to edit the depth and the positional relationship with other objects without any physical breakdown. It also allows you to apply 'object texture changes' using a physics engine to an image, making it possible to edit objects in the image by softening and bending them. In the example below, MiraGe is used to edit objects by 'moving a triangular object while bending it softly' and 'changing the direction and expression of a person's face.'
Below is an example of editing using MiraGe. Click on the image to see the animation in which the children's arms move without any physical breakdown and the cloth sways realistically.
By making full use of the physics engine, you can also create an animation in which a statue turns into sand and crumbles.
The source code for the MiraGe reference implementation is available at the following link.
GitHub - waczjoan/MiraGe: Official implementation of 'MiraGe: Editable 2D Images using Gaussian Splatting'
https://github.com/waczjoan/MiraGe/
Related Posts:
in Software, Posted by log1o_hf