An experiment in computer control by designerzen. By allowing your webcamera access, every movement of your face and mouth will control aspects of music. Pressing the screen or holding your eyes closed will change instruments.
The very first proof-of-concept was created in December 2021 and demostrated at DMLab December 2020
Beta version 5 was shown for the first time at the Music Maker Festival 2021 where the opton to use closed eyes to change instruments per user was added
Allow recording of performance per person
Allow recording of all data in realtime to be downloaded
Adding the ability to record every aspect of your performance and replay both the audio and video
MIDI 2.0 (MPE) Support to control modern polyphonic instruments via MIDI cable
Ideally a natural sounding synth could replace or be added to the existing sample based audio engine which would not only sound more interesting but would allow fun fun effects such as pitch bending, micro-tonality and vibrato.
Saving your musical composition as a MIDI file to your local device to use with other software such as a DAW.
The use of other body parts to control the interface. Current plans include tracking the hands as well as a full body shape as input mechanisms.
Saving "Persons" and using face ID loading them back in
Integrated head, body and hands into one interface with smart detection and automatic gesture learning
Small Hardware Run - USB MIDI to GPIO adapter - a usb cable that when connected to the computer communicates with the InterFACE and allows other electronics to be wired in and controlled.
Permanent installation at the
"Accessible Musical Instrument Museum (AMIC)"as an experience for a single player at a time that uses the Looking Glass Holographic Display mounted inside an Arcade BoothPermanent exhibit at the
"Accessible Musical Instrument Museum (AMIC)" using a projector, a high power computer and a ceiling mounted camera would allow multiple people to play music simultaneously.Permanent installation at the "Accessible Musical Instrument Museum (AMIC)" as an experience for a single player at a time that uses the Looking Glass Holographic Display mounted inside an Arcade Booth
Implement learning mechanism for training gesture recognition
Add the ability to track faces even if they cross
Add facial recognition to retain session wihout interaction