Augmenting Digital Sheet Music through Visual Analytics:
Music analysis tasks, such as structure identification and modulation detection, are tedious when performed manually due to the complexity of the common music notation (CMN). Fully automated analysis instead misses human intuition about relevance. Existing approaches use abstract data-driven visualizations to assist music analysis but lack a suitable connection to the CMN. Therefore, music analysts often prefer to remain in their familiar context. Our approach enhances the traditional analysis workflow by complementing CMN with interactive visualization entities as minimally intrusive augmentations. Gradual step-wise transitions empower analysts to retrace and comprehend the relationship between the CMN and abstract data representations. We leverage glyph-based visualizations for harmony, rhythm and melody to demonstrate our technique's applicability. Design-driven visual query filters enable analysts to investigate statistical and semantic patterns on various abstraction levels. We conducted pair analytics sessions with 16 participants of different proficiency levels to gather qualitative feedback about the intuitiveness, traceability and understandability of our approach. The results show that MusicVis supports music analysts in getting new insights about feature characteristics while increasing their engagement and willingness to explore.
https://www.youtube.com/watch?v=iLgD3f18rS0▾
❤️ 2
🤯 2
e
Evan Payne
05/30/2022, 10:16 AM
😍 So cool.
Evan Payne
05/30/2022, 10:16 AM
For years, this guy's been doing a similar thing manually:
https://www.youtube.com/watch?v=VeYGRNhUHxE▾
💯 1
j
Jan Ruzicka
05/30/2022, 7:29 PM
Imagine a similarly capable tool for analysing programs…
That would need much more developed theory of language semantics / behaviours / cybernetics, however.
e
Evan Payne
05/30/2022, 7:57 PM
Well, I imagine that's what Github Copilot is working towards. They have that new "Explain this code to me".. And that in turn is very reliant on syntax highlighting and AST's.