logoalt Hacker News

oever • today at 1:59 PM • 1 reply • view on HN

Audio-to-MIDI sounds very ambitious. How do you verify that the midi fits the audio? Does it result in useful beat detection? E.g. I'd very much like to have a way to map audio offset in a recording to labels in sheet music. But even beat detection in fairly standard jazz recordings fails often.

Does the model know when a piece (whole piece, not a section) is 3/4 or 4/4 th and can it give the onsets of all measures? Or all the midi notes just based on time and not organized rhythmically?


Replies

gunalx • today at 3:49 PM

Its definetly a problem where generating the trivial version of synthetic data is easy though.