ICM Sound Experience
FANTASIA!!
For this project, Douglas and I spent a lot of time conceptualizing before we started coding. We looked at exploring the circle of 5ths, working with chords, making a harpejji, and many other ideas. When looking for examples online, we actually came across a project by ITP 2nd Year Student, Adi Dahiya in where he used posenet to make a soundboard. We loved the idea and decided to iterate on it. His version played sounds that he loaded in, sound effects like a minion from Despicable Me and other sounds. We wanted to do something similar, but with oscillators instead.
So instead of a sound board, we made a keyboard that played the notes from C4 - C5 (skipping the half steps along the way, only keeping 8 notes). The way it works is you place your wrist over the note that you want to play, and dropping your nose below the halfway mark of the screen plays the sound, while raising the nose above it cuts the sound. I thought it was pretty fun to see someone bobbing their head to play the notes on our instrument. During play testing, I thought that the black nose on Douglas gave him a bit of a Mickey Mouse look, so we added the Fantasia hat and Mickey Gloves to perfect the look.
Here’s a link to the project.
https://editor.p5js.org/patconwar/sketches/4z70lmERf
Play Test Video