TART模型实现吉他音频转六线谱,支持滑音等演奏技巧标注
TART: A Modular Tool for Technique-Aware Audio-to-Tablature Guitar Transcription
想用AI生成吉他谱的朋友可以看看这个TART模型,它专门处理吉他音频,能识别滑音、弯音等技巧,比之前的方法准确率更高。
TART是一个四阶段模块化流程,包含音频转MIDI模型、演奏技巧分类器、带音频条件的T5编码器解码器用于弦品分配,以及自动六线谱生成器。在GuitarSet、EGDB等基准测试上,其音频转MIDI F50达到81.35%,弦品分配F1达71.8%,是首个能直接从吉他音频生成带指法和技巧标注的六线谱框架。
TART: A Modular Tool for Technique-Aware Audio-to-Tablature Guitar Transcription
Automatic Music Transcription (AMT) for guitar remains limited by three challenges: existing systems often fail to capture expressive techniques such as slides, bends, and percussive hits; they often assign notes to incorrect string-fret combinations; and they are typically trained on clean recordings, limiting their generalization to noisy real-world audio. To address these challenges, we propose TART, a modular four-stage audio-to-tablature pipeline consisting of (1) an audio-to-MIDI transcription model, (2) an expressive technique classifier, (3) an audio-conditioned T5 encoder-decoder for string-fret assignment, and (4) an automated tablature generator. We evaluate TART in a zero-shot setting on GuitarSet, EGDB, and two augmented benchmarks, Noisy GuitarSet and Noisy EGDB. Averaged across these four benchmarks, TART achieves 81.35% audio-to-MIDI F50 (+6.67 points over the best prior baseline), 71.8% string-fret Tab F1 (+8.5 points over the best prior baseline), and 54.08% end-to-end Tab F1. To our knowledge, TART is the first framework to generate guitar tablature with both fingering and expressive technique annotations directly from guitar audio.