shlogg · Early preview
Mike Young @mikeyoung44

AI System Tracks Live Music With Sheet Music In Real-Time

AI system maps live music to sheet music in real-time using Gaussian Process regression, processing audio in 18ms segments & working on piano, violin, oboe & flute performances.

This is a Plain English Papers summary of a research paper called AI System Tracks Live Music with Sheet Music in Real-Time. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter.

  
  
  Overview

Novel approach to score following using Gaussian Process regression
Maps live musical performance to positions in sheet music
Uses two-stage system: note prediction followed by position tracking
Works on piano, violin, oboe and flute performances
Processes audio in 18ms segments for real-time following
First application of Gaussian Processes to score following...