Loading Musirion

Technology

Piano transcription technology

Musirion uses a two-stage pipeline: first it converts a selected solo source into MIDI-like musical events, then it converts those events into editable sheet music. Piano is the primary and most mature mode; the additional instrument and voice modes are Beta.

Two-stage transcription pipeline

Input

Audio recording

one solo instrument or voice · audio or video file

Stage 1

Audio → MIDI

note pitches · note onsets · note durations · sustain pedal in piano mode · MIDI velocity

Stage 2

MIDI → Sheet Music

measure structure · rhythmic notation · voices · hand and staff assignment · tempo · MusicXML generation

How it works

  • In-house music AI models: Musirion uses in-house models and a custom audio-to-events-to-notation pipeline. Piano is the primary and benchmarked mode; guitar, bass, violin, viola, cello, flute, B-flat clarinet, E-flat alto saxophone, B-flat tenor saxophone, B-flat trumpet and voice are available in Beta.
  • Stage 1: Audio to MIDI: note pitches, note onsets, note durations, sustain pedal in piano mode and MIDI velocity.
  • Stage 2: MIDI to sheet music: measure structure, rhythmic notation, score durations, voices, hand and staff assignment, tempo and MusicXML generation.
  • Editable MusicXML output: MIDI can be opened in DAWs and piano-roll editors. MusicXML can be opened in notation software such as MuseScore, Sibelius and Dorico.
  • Current limitations: each recording must contain one solo instrument or voice. Musirion does not separate vocals, accompaniment or instruments in songs and ensemble recordings. Complex passages, ornaments, noise and heavy reverb can also reduce quality; additional instrument and voice modes are Beta.

Technology FAQ

Does Musirion use its own AI models?

Yes. Musirion uses in-house music AI models and a custom pipeline. Piano is the primary and benchmarked mode; additional solo instrument and voice modes are Beta.

How does Musirion convert audio to sheet music?

The system first extracts MIDI-like musical events from the audio, then converts those events into readable notation and MusicXML.

What is the difference between MIDI and MusicXML?

MIDI describes musical events such as pitch, timing and velocity. MusicXML describes editable notation that can be opened in score editors.

Why is solo piano transcription difficult?

Piano recordings often contain dense chords, overlapping notes, sustain pedal, expressive timing and two-hand notation.

Related tools and pages