Show HN: Public Muscriptor Instance (latest, most powerful Audio-to-MIDI model)

57 points
1/21/1970
5 days ago
by jardy

Comments


homarp

it uses https://muscriptor.kyutai.org/

https://kyutai.org/blog/2026-07-10-muscriptor/ says We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with Mirelo. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.

3 days ago

embedding-shape

Woah, that's much more interesting, as it seems to handle more than just the lead instrument/piano, as this Show HN does. Thanks for sharing that, very useful!

3 days ago

fweimer

I wonder what the intent is behind releasing the weights under a CC-BY-NC license. Is it about restricting any commercial use of the weights, including for inference?

3 days ago

jardy

absolutely - thanks for the reference.

3 days ago

epiccoleman

Wow, this works way better than I expected. Fed it "Shimmer and Out" by Lotus, the intro of which is just a pretty simple guitar riff based around triad shapes - but it's the kind of thing I've seen Chordify just mangle. This produced a transcription that sounds 1:1 to my ear.

Could totally see myself using this as part of the tools I use to learn music - and I could also see someone eating Chordify's lunch by hooking up a model like this and doing note-level theory analysis in addition to whatever spectral analysis model they're using.

3 days ago

jardy

ah, thanks mate. this isn't even their most powerful model - i'd recommend using the Mirelo API to access their most powerful variant or self-host on a GPU.

3 days ago

jardy

3 days ago

mohanz

Nice!

3 days ago

Zopieux

I'm not sure I get it. This looks like a worse repackage of muscriptor but with a 10s limit, making it useless.

3 days ago

jardy

you're not wrong. the main problem is the public instance of muscriptor (https://muscriptor.kyutai.org/) is poorly handled in terms of backend infrastructure, and i often run into errors and rate-limiting. this is just a more niche version of it on my own GPU so the public can use it more.

3 days ago

chandramoulyKK

Wow! Perfectly did the whole intro of 'In the end'!

3 days ago

jardy

niceee

3 days ago

bartleeanderson

Claude told me all the stuff to rip out and replace with FOSS. Should have been done that way in the first place, but you can't blame a guy for trying to make money these days. Except Trump...

2 days ago