技术
钢琴转录技术
Musirion 采用两阶段流程:先将所选独奏声源转换为类似 MIDI 的音乐事件,再将这些事件转换为可编辑乐谱。钢琴是主要且最成熟的模式,其他乐器和人声模式仍处于 Beta 阶段。
两阶段转录流程
输入
音频录音
one solo instrument or voice · audio or video file
阶段 1
音频 → MIDI
note pitches · note onsets · note durations · sustain pedal in piano mode · MIDI velocity
阶段 2
MIDI → 乐谱
measure structure · rhythmic notation · voices · hand and staff assignment · tempo · MusicXML generation
使用方法
- In-house music AI models: Musirion uses in-house models and a custom audio-to-events-to-notation pipeline. Piano is the primary and benchmarked mode; guitar, bass, violin, viola, cello, flute, B-flat clarinet, E-flat alto saxophone, B-flat tenor saxophone, B-flat trumpet and voice are available in Beta.
- Stage 1: Audio to MIDI: note pitches, note onsets, note durations, sustain pedal in piano mode and MIDI velocity.
- Stage 2: MIDI to sheet music: measure structure, rhythmic notation, score durations, voices, hand and staff assignment, tempo and MusicXML generation.
- Editable MusicXML output: MIDI can be opened in DAWs and piano-roll editors. MusicXML can be opened in notation software such as MuseScore, Sibelius and Dorico.
- Current limitations: each recording must contain one solo instrument or voice. Musirion does not separate vocals, accompaniment or instruments in songs and ensemble recordings. Complex passages, ornaments, noise and heavy reverb can also reduce quality; additional instrument and voice modes are Beta.
技术常见问题
Musirion 使用自己的 AI 模型吗?
是的。Musirion 使用自研音乐 AI 模型和定制流程。钢琴是主要且经过基准测试的模式;其他独奏乐器和人声模式为 Beta。
Musirion 如何将音频转换为乐谱?
系统先从音频中提取类似 MIDI 的音乐事件,再将这些事件转换为易读的记谱和 MusicXML。
MIDI 与 MusicXML 有什么区别?
MIDI 描述音高、时间和力度等音乐事件;MusicXML 描述可在乐谱编辑器中打开的可编辑记谱。
为什么独奏钢琴转录很难?
Piano recordings often contain dense chords, overlapping notes, sustain pedal, expressive timing and two-hand notation.
相关工具和页面