Mock-up: AR Sheet Music

In thinking of physical objects that would work well in AR space, I came across sheet music and couldn’t really shake the idea of how nicely it would work in AR. As someone who’s kept sheet music around for various instruments, one frustration was that sometimes my brain just couldn’t wrap my head around how something was supposed to sound. If I could point my phone at the sheet and have a snippet played for me, it would be able to pick up where I left off right away, just a quick boost to keep my progress up. Here’s a video mockup of what I had in mind.

This was just a quick mockup to get a look going. After looking at it a few times, I think that a further iteration would have individual notes changing color as opposed to the whole bar for more specificity. Maybe some kind of playhead on a timeline would be helpful if the user wanted to go over a specific part.