Feb 29, 2024 11:19:00

Adobe announces “Project Music GenAI Control”, a music version of Photoshop equipped with generation AI

Adobe has announced ' Project Music GenAI Control ,' a music generation and editing software equipped with generation AI. By using Project Music GenAI Control, users can generate music from text prompts and use the generated music to edit audio.

Here's how generative AI is about to revolutionize audio creation and editing | Adobe Blog

https://blog.adobe.com/en/publish/2024/02/28/adobe-research-audio-creation-editing

Adobe announces new prototype AI tool for creating and editing audio - The Verge
https://www.theverge.com/2024/2/28/24085551/adobe-project-music-genai-control-prototype-tool-hot-pod

Adobe has released the following movie on YouTube that introduces Project Music GenAI Control.

Project Music GenAI Control | Adobe Research - YouTube


To generate music with Project Music GenAI Control, enter text that specifies the style of music you want to generate, such as 'powerful rock,' 'happy dance,' 'sad jazz,' or 'orchestral style.'

Then, the built-in generation AI will generate the music you specified. At the same time,

a spectrogram of the generated music is displayed in the window.

Furthermore, based on the music generated by Project Music GenAI Control, you can adjust the music's tempo, structure, and repeat pattern directly on the tool, and you can also perform cut editing. Adobe says that you can easily remix the generated music and set loops for BGM of video content.

'With Project Music GenAI Control, generative AI becomes your co-creator,' said Nicholas Bryan, senior research scientist at Adobe Research. It's useful for casters and others to create music for their projects.'

Various companies are already developing AI that generates music, such as Google's

MusicLM and Meta's AudioCraft . However, although these have the ability to generate music as input at the text prompt, there is almost no support for editing the music output as is. This means you either have to keep generating music until you get the desired result, or you have to manually edit the music using editing software.

'One of the most exciting things about Project Music GenAI Control is that it not only generates music, but also provides creators with Photoshop-like controls to shape, tweak, and edit audio,' said Brian. 'Project Music GenAI Control can control music at the pixel level.'

Project Music GenAI Control is being jointly developed by the University of California and Carnegie Mellon University, and Adobe describes it as an 'early stage experiment.' There is a possibility that Project Music GenAI Control will be incorporated into existing editing software such as Audition or Premiere Pro in the future, but at the time of writing this article it has not yet been made available to the public and no release date has been announced.