What is the 'AI DJ Project', an improvisational session that uses AI to create unconventional music?
The ' AI DJ Project ' is a project that aims to bring a new musical experience to the audience by performing the highly improvised art of DJ performance through the interaction of humans and AI. Two versions have been developed so far by Qosmo, led by Nao Tokui, who was involved in artificial intelligence research during the doctoral course at the University of Tokyo.
AI DJ Project — A dialogue between AI and a human | ART | Qosmo --CULTIVATE THE CHAOS
AI DJ Project # 2 Ubiquitous Rhythm — A Spontaneous Jam Session with AI | ART | Qosmo --CULTIVATE THE CHAOS
https://qosmo.jp/projects/ai-dj-project2-ubiquitous-rhythm/
In 2018, the first AI DJ Project 'A dialogue between AI and a human' was released. This is a style of 'Back to Back' in which two DJs take turns playing songs with humans and AI. AI DJ developed by Qosmo listens to songs played by humans on the spot, and selects and plays songs with similar musical tone, mood and texture from more than 350 songs prepared in advance. am. You can see the performance in the video below.
AI DJ Project --A dialog between human and AI through music from Qosmo / Cosmo on Vimeo
In addition, AI DJ uses motion tracking technology using deep learning to quantify 'how much the audience is dancing' and select songs according to the atmosphere of the place. However, when Mr. Tokui and others performed in various places including Japan, Europe and the United States, AI DJ sometimes chose songs that were in line with the flow, and sometimes they chose songs that were outrageous. Qosmo explains that this 'unpredictability' creates tension in performance and inspires human DJs.
In Back to Back, the technique of matching the beat and tempo of a song is also important in order to smoothly connect the other song to your own song. AI DJ uses a computer-controlled custom DJ turntable and robot fingers to physically perform, but while it's relatively easy to match the speed (tempo) of a song, the beat phase It is very difficult to match. Qosmo said it would improve the accuracy of beat matching.
Then, in 2021, 'Ubiquitous Rhythm', in which AI DJ composes music on the spot and interacts with humans, has appeared. This is a 'rhythm generation model' that randomly creates the rhythm of a song, a 'rhythm → bass conversion model' that 'translates' a drum pattern to a baseline based on a large amount of data, and rhythms such as melody and sound effects. -It is a combination of three 'loop selection models' that select parts other than the base. You can check the performance video from the following.
In this project, a human DJ can listen to a song created by AI DJ, adjust the tone of a drum machine or synthesizer, and control the volume and effects of the song to build a musical development. And that. Human manipulation also indirectly affects the loops selected by AI DJ, which makes it unpredictable and never produces the same performance again, which is surprising, highly reciprocal and improvised. It is said that performance has been achieved.
Qosmo said, 'The groove created by the interaction of DJ and multiple music generation models seems to foresee the form of creativity in a new era where humans and AI coexist. As a result, DJ is a disc (record). Instead, I was asked to be an 'AI Jockey' that manages AI. Beyond that, I think I got a glimpse of the future creators who will be required to be AI Jockey in general. ' Did.
Related Posts:
