Summary

Vocal to MIDI is a feature of ACE Studio that converts vocal tracks into MIDI clips with corresponding lyrics. It facilitates detailed vocal production and editing, including melody, lyrics, voice, and emotion based on existing or newly recorded vocals.

Functionality

• Converts vocal audio tracks into MIDI clips containing note and lyric information.
• Supports selection between different conversion models (V1 and V2) that prioritize phoneme or lyric recognition respectively, with several language options including English, Spanish, Chinese, Japanese, and Korean.
• Offers an auto-detect language option and a "MIDI only" option to extract note information without lyrics or to handle other languages.
• Allows preserving the original vocal pitch curve during conversion, enabling pitch adjustment after lyric changes.
• Intended specifically for acapella vocals; presence of instruments or effects like delay or reverb may impair accuracy.
• Supports conversion of only a single language per audio clip; for multi-language audio, "MIDI only" mode or splitting is recommended.

Usage

• Conversion can be initiated by dragging and dropping an audio clip onto a singer track.
• Alternatively, users can click the "Vocal to MIDI" button in the audio editor's left tool panel or select "Vocal to MIDI" from the right-click context menu under "AI tools."

Notes

Users need to carefully manage pitch curves when editing lyrics to maintain natural pronunciation. Further details on pitch editing are available in the documentation. The feature is part of the broader set of AI tools integrated within ACE Studio.