I tried using the AI voice synthesis software 'Seiren Voice' that anyone can use as the voice of 'Yuzuki Yukari' or 'Kotoba Akane / Aoi' just by recording with a microphone.



Dwango Media Village , the machine learning technology research division of Dwango, to which Mr. Hiho , who has developed voice conversion technology and voice synthesis software 'VOICEVOX' that anyone can easily become the voice of 'Yuzuki Yukari', has AI voice synthesis software. Announced ' Seiren Voice '. Seiren Voice automatically transcribes the voice recorded with the microphone and can convert it to the voice of Yuzuki Yukari , Akane Kotonoha, Aoi while reproducing the intonation, so actually install the free trial version and use it I checked the conversion accuracy.

High quality voice conversion software | Seiren Voice
https://seiren-voice.dmv.nico/

·table of contents
◆ 1: Installation procedure of Seiren Voice & voice library
◆ 2: Procedure for converting voice with Seiren Voice
◆ 3: I tried to convert the voice of the editorial staff to voice with Yuzuki Yukari with Seiren Voice
◆ 4: I added Kotonoha Akane / Aoi's voice library to Seiren Voice.
◆ 5: Summary

◆ 1: Installation procedure of Seiren Voice & Voice Library
Seiren Voice can convert recorded voice to the desired voice by adding a voice library such as 'Seiren Voice Yuzuki Yukari' or 'Seiren Voice Kotonoha Akane / Aoi' to the basic software. 'Seiren Voice Yuzuki Yukari' and 'Seiren Voice Kotonoha Akane / Aoi' have trial versions, so first try installing the trial version of 'Seiren Voice Yuzuki Yukari'.

First, access the official page of 'Seiren Voice Yuzuki Yukari' from the link below.

Yuzuki Yukari | Seiren Voice
https://seiren-voice.dmv.nico/product/yukari



Then click 'Download Trial'.



The trial version is distributed in ZIP format, so decompress it with decompression software such as '

Explzh '. The ZIP file contains the Siren Voice installer and the voice library related to Yuzuki, so double-click the installer to start it.



When the license agreement is displayed, read it carefully and click 'Agree'.



Next, the installation user selection screen is displayed. This time, I selected 'Install only for current users' and clicked 'Next'.



Then, the installation folder selection screen is displayed. This time, click 'Install' without changing anything.



Wait for a few tens of seconds ...



The installation of Seiren Voice is completed, so click 'Finish' to close the installer.



Siren Voice will start automatically when you close the installer. At the first startup, a dialog instructing you to install the audio library will be displayed, so click 'OK'.



Then, the setting screen opens, so click 'Install Audio Library'.



When the file selection screen is displayed, select the audio library included in the folder you unzipped earlier.



When the terms of use are displayed, read them carefully and click 'OK'.



Then, the audio library will be installed. Click 'OK' when the installation completion notification is displayed.



Installation is successful if Yuzuki Yukari is added to the setting screen. Click 'Close' to close the setting screen.



◆ 2: Procedure for converting voice with Seiren Voice
Below is the screen of Seiren Voice. To perform audio conversion, first click the orange microphone button and blow the audio into the microphone.



The voice will be transcribed automatically, so click the blue play button.



Then, it will be converted to the voice of the selected voice library (this time Yuzuki Yukari), so wait for a few seconds.



When the conversion is complete, the converted audio will be played. If you want to continue voice conversion, click the blue button at the bottom right.



The converted audio can be output by clicking 'Export All' at the top of the screen.



The output audio is saved in WAV format. Also, the transcribed text file is output at the same time.



◆ 3: I tried to convert the voice of the editorial staff to voice with Yuzuki Yukari with Seiren Voice
I tried to convert the voices of two editorial staff into the voices related to Yuzuki with Seiren Voice. The voice qualities of the two are different, but the converted voices are both Yuzuki Yukari voices. In the trial version, a watermark is added to the output audio, but this time we have a special watermark removed.

I tried to convert the voices of two editorial staff into the voice of Yuzuki Yukari with 'Seiren Voice' --YouTube


In addition, Seiren Voice can convert the voice while reproducing the intonation of the recorded voice. In the following movie, you can check the conversion result when the same sentence is read aloud with normal intonation, interrogative intonation, and intonation that emphasizes.

'Seiren Voice' can convert voice while maintaining intonation-YouTube


In addition, Siren Voice has the ability to change the pitch and intonation of the voice.



In the following movie, you can hear and compare the conversion results of the same recorded audio when changing the height and intonation.

I tried changing the pitch and intonation of the voice with 'Seiren Voice' --YouTube


◆ 4: I added Kotonoha Akane / Aoi's voice library to Seiren Voice.
With Seiren Voice, you can increase the types of converted voice by adding a voice library. This time, I will add the voice library of Kotonoha Akane and Aoi.

First, click the link below to access the Kotonoha Akane / Aoi voice library distribution page.

Kotonoha Akane / Aoi | Seiren Voice

https://seiren-voice.dmv.nico/product/kotonoha/



After accessing the distribution page, click 'Download Trial Version'.



The trial version is distributed in ZIP format, so unzip it and double-click the audio library with the extension '.srvl'.



If you read the terms of use carefully and click 'OK' ...



The Siren Voice setting screen and installation completion notification will be displayed automatically, so click 'OK'. This completes the addition of the audio library.



To switch the audio library, click the part with the name of the audio library and select the desired audio library.



This completes the switching of the audio library. If you convert the voice in this state, the voice will be converted to Kotonoha Akane / Aoi Voice.



In the following movie, you can see the result of converting the voice of the editorial staff into Kotonoha Akane / Aoi voice.

I tried to convert the voice of the editorial staff to Kotonoha Akane / Aoi voice with 'Seiren Voice' --YouTube


◆ 5: Summary
When I actually converted the voice with Seiren Voice, the voice recorded by the microphone was automatically recognized, so it was possible to create a synthetic voice without the hassle of transcribing. In addition, since the voice can be converted while maintaining the intonation, even if you want to express emotions such as surprises and doubts, you can create a synthetic voice quickly without having to mess with the parameters. When creating a work using synthetic voice, it is necessary to 'play with parameters endlessly after inputting a large amount of characters', but it seems that you can work on the work very easily if you use Seiren Voice.

However, 'Compute Capability 5 or higher NVIDIA GPU' is required to operate Seiren Voice. If you're not sure if your PC supports Siren Voice, we recommend using the free trial version to check.



In addition, the following movie released by Mr. Hiho talks about the development process of Seiren Voice. The movie also talks about the prospects for real-time conversion.



The basic software of Seiren Voice is distributed free of charge, and the voice library is sold for 19,800 yen including tax for both 'Yuzuki Yukari' and 'Kotoba Akane / Aoi'. In addition, the voice library of 'Kizuna Akari' will be released. Regarding commercial licenses, the sales page has not been published at the time of article creation, and we are responding to inquiries.




Related Posts:

in Review,   Software,   Video, Posted by log1o_hf