Skip to content

Notice

Dreamtonics has released a comprehensive official user manual along with version 1.11.0 of Synthesizer V Studio; this unofficial manual will no longer be maintained. Please visit the Official User Manual for all future updates and information.

Voice-to-MIDI Conversion

Pro Feature

The features described below require Synthesizer V Studio Pro.

Synthesizer V Studio can transcribe a MIDI sequence based on a monophonic audio sample.

Right-click on either an instrumental preview or ARA-synced group in the Arrangement Panel and select "Extract Notes from Audio".

Extract Notes from Audio

Conversion Options

Voice-to-MIDI dialog

Note Detection Sensitivity

Higher values will be more accurate, but may be prone to erroneously creating more notes than necessary and separating single sustains into multiple notes if there are fluctuations in dynamics.

Pitch Correction

If disabled, detuned notes may be present in the transcribed MIDI.

Phonetic Lyric Transcription

Detects the phonetic content of the audio sample and attempts to assign phonemes to the transcribed notes to match the phonetic content of the original performance. The accuracy of this will be largely reliant on the clarity of the original recording.

If not selected, the default lyric as defined in the Settings panel will be assigned to each note ("la" by default).

Transfer Pitch onto Converted Notes

Adds pitch deviations to the Parameters Panel to match the pitch of the original audio in a moment-to-moment manner. Transcribed notes will have Manual Pitch Mode enabled so that the detected pitch is not overwritten by automatic pitch generation.

If not selected, the notes will default to Sing Pitch Mode and an AI-generated pitch curve will be applied to them.

Language

If "Phonetic Lyrics Transcription" is enabled, the Language dropdown can be used to restrict the transcription to a specific language's phoneme set.

Multi-threaded analysis

If enabled, Voice-to-MIDI Conversion will complete more quickly. If reducing CPU load or heat is a priority, you may opt to disable this option in exchange for slower processing times.

Working with Converted MIDI

After the conversion process has completed, the transcribed MIDI will be added to the currently selected track as a Note Group.

The conversion process will not quantize the notes, and may have inaccurate phoneme transcriptions. Depending on the accuracy of the original audio's timing, you may want to execute "Smart Quantization" from the "Modify" top menu on the notes. You should also review the results to identify any incorrect phonemes or pronunciations that may need adjusting.

Video Demonstration

Troubleshooting

If you encounter technical issues with the plugin, try removing the software and reinstalling to the default installation directory.

If the problems persist, search for similar issues on the official forums or contact Dreamtonics support.


Report an Issue