tl;dr: I did animation/graphics (PaperJS), interaction (WebMidi) and sound-synthesis and playback (WebAudio) in Javascript.
To showcase Chrome during Google Summit 2017 in San Francisco, Google commissioned Plan 8 to create an installation. We approached this in two parts. First, attendees interacted with a singing* animation through tactile surfaces (Roli LightPads Midi Controllers) using Web technologies (WebMidi, WebAudio and SVG Graphics) running in Chrome. The second part of the installation was a remote controlled baby grand piano that turned visitors messages into jazz music. The two pieces created a duet that could be played in harmony. I was responsible for creating the graphic animations, user interaction, and audio synthesis of the Vocalizer and was involved in the development of the Jazz Messenger.
