Adobe announces its own generative AI 'Firefly', integration into Creative Cloud such as Photoshop and Illustrator



On March 21, 2023, Adobe, familiar with creative tools such as Illustrator and Photoshop, announced the generative AI `` Firefly '' that can provide unique image generation functions and text effects. Firefly will be integrated into Adobe Creative Cloud in the future, bringing more precision, power, speed and ease to creating and modifying content.

Adobe - Adobe Unveils Firefly, a Family of new Creative Generative AI

https://news.adobe.com/news/news-details/2023/Adobe-Unveils-Firefly-a-Family-of-new-Creative-Generative-AI/default.aspx

Adobe Unveils New Generative AI, Adobe Firefly
https://www.adobe.com/jp/news-room/news/202303/20230321_adobe-unveils-firefly.html

Adobe has announced that it designed Firefly so that all creators can create creative activities as they are. With Firefly, content creators, regardless of experience or talent, can create content exactly as they imagined, based on their own words, with images, audio, vectors, videos, 3D, brushes, color gradients, video conversions, and more. can be generated more easily and quickly than ever before. In addition, by embedding Firely directly into Adobe's industry-leading tools and services, users will be able to easily leverage generative AI within their existing workflows.

You can see what kind of image generation and text effects can actually be done with Firefly by watching the following video.

Adobe Firefly: Family of New Creative Generative AI Models-YouTube


Enter 'Change scene to winter day' in the text box and click 'Generate'.



In an instant, a landscape photo with vivid greenery becomes a winter scene.



In addition, you can see that they have prepared variations such as 'winter day with snow', 'winter day when snow is melting', and 'winter day when snow falls'.



As you can see in the video, the snow falls steadily and piles up.



Illustration of a dog.



Specify the range of characteristic curled hair.



Then click 'Generate Similar Brushes'.



Since multiple types of brushes are generated, select one of them.



Then you can easily create a brush that reproduces the dog's characteristic coat.



3D model of the watch.



Applied leather texture to the band.



In addition, a metal texture is placed on the housing part of the watch.




Then, Firefly will prepare variations of leather and metal textures as follows.





Fill the grass illustration with blue.



Select 'River' from the textures.



Then the solid blue color turned into a beautiful river.



Place trees. There are many variations.



You can easily generate beautiful illustrations just by arranging buildings and creatures like this.



There is also a function to create a template called 'Generate template'.



Enter 'Create template from mood board' and click 'Generate Template'.




Select template style.



You can create your own template by modifying the objects placed in the template.



Enter 'Very detailed futuristic

red snapper bin '.



Firefly outputs the following image.



Added background.



If you apply more effects, you can create a very sophisticated image.



Select a range of already completed illustrations.



Then, the area around the building was masked.



Click 'Generate Variations'.



Then, it is possible to change only the building part to a different variation.





Enter 'underwater city' and click 'Generate'.



Then, an underwater city that matches the atmosphere of the illustration was generated in one shot.



Load the handwritten font, enter 'Vector variation of this sketch' and click 'Generate'.



Then, a vector font is generated based on the handwritten sketch.



Of course, editing is also possible.



Furthermore, select the font and click 'Generate Text Styles'.



You can then add different textures to your text.



If you enter 'MEOW' with this texture, it will be as follows.




In 'Train your model', you can request AI to generate an image based on the image you input.



Enter 'Place my headphones in the studio'.



The following image was generated.



Enter 'My headphones in an outdoor backpack'.



Then the headphones were hung in the outdoor backpack.



Firefly



In the future, Firefly will consist of multiple models, tailored to cover a wide range of use cases for users with different skill sets and technical backgrounds. However, the first models are trained on images from Adobe Stock , Adobe's photo stock service, as well as license-free and out-of-copyright public domain content. In other words, the images and effects generated by Firefly are designed to be safe for commercial use. Firefly also infringes on the IP (intellectual property) of other creators and brands, as the material available on Adobe Stock is the highest quality on the market, with hundreds of millions of professionally licensed images. We do not generate content that does.

In addition, Adobe plans to add multiple models in Firefly that utilize various assets, technologies, and training data provided by other sources, but we will prioritize addressing potential biases in their implementation. I promise.

The features of Firefly are as follows.

・Improve production efficiency for creators
Content is the engine of the global economy, and creativity and design are valued today more than ever. According to a recent Adobe survey, 88% of brands say their content demand has more than doubled in the past year, and two-thirds expect that demand to increase fivefold over the next two years. I'm here. To help ease the strain on creators that this increased demand is putting, Adobe is delivering solutions that make work faster, smarter, and more convenient with generative AI. This includes the ability to train Firefly with your own collateral (such as images and marketing materials) to generate content based on your unique style and brand language.

・ Compensation for creators
Adobe plans to build a generative AI service with the aim of creating opportunities and mechanisms for professional creators to monetize their work, as they have done with Adobe Stock and Behance. At Adobe Stock, if a creator (contributor) provides stock material for AI training, we are considering a way for creators to receive revenue from images generated by Firefly based on that dataset. increase. More information will be provided once Firefly is out of beta.

・Proposals for open standards
Adobe established the Content Authentication Initiative (CAI) to create a trusted global standard for attribution of digital content. With more than 900 members worldwide, CAI's role has never been more important. Through the non-profit Coalition for Content Provenance and Authenticity (C2PA), Adobe makes the active CAI open source tools free and promotes open industry standards. These goals also include the ability to tag image content credentials with a “Do Not Train” tag to request that creator-owned content not be used to train models. This tag remains associated with the content throughout its use, publication, and storage, and AI-generated content is also tagged as 'AI-generated.'

・Firefly ecosystem
Adobe plans to make Firefly available via APIs on various platforms for customers to integrate into custom workflows and marketing automation.

Along with the announcement, a private beta version of Firefly was also released. You can join Firefly's private beta here:

AI Art Generator – Adobe Firefly
https://www.adobe.com/sensei/generative-ai/firefly.html



Adobe plans to evolve Firefly and integrate it into its applications as it engages with the creative community and users through the private beta process. Adobe Express, Adobe Experience Manager, Adobe Photoshop, Adobe Illustrator, etc. are planned as applications that Firefly will be integrated in the future.

in Software,   Video, Posted by logu_ii