@supports(animation-timeline:--page) { html { scroll-timeline: --page-scroll block; } @keyframes grow-progress { from { transform: scaleX(0); } to { transform: scaleX(1); } } #progress { position: fixed; left: 0; bottom: 0; width: 100%; height: 1em; background: var(--shade-red, red); transform-origin: 0 50%; animation: grow-progress auto linear; animation-timeline: --page-scroll; } }
PhotoSYNTH3 logo that resembles the shape of a human mouth with tonsils

The PhotoSYNTHs are a range of multiplayer, collaborative, mixed-reality POP music factories that grant anyone nearby with radical new musical superpowers!

The second version of the PhotoSynth being demonstrated by Gawain Hewitt

The PhotoSYNTH II being demonstrated by Gawain Hewitt in 2014

Having long ago developed the "PhotoSYNTH II : POP Music Factory" with the help of #DMLab, and in order to celebrate ten year since the last version, it was time to push it into the third dimension... and beyond!

The "PhotoSYNTH 3 #interFACE" is a web-based music creation technique which instantly transforms anybody it sees into a musical instrument and any group of people into a band!

By tracking your motions and emotions in real-time, this magic mirror converts your everyday movements into beautiful music - making it one of the easiest and most fun synthesizers to play, yet remains highly expressive and capable of high fidelity.

Rather than playing a musical instrument, the PhotoSYNTH plays you!

Without any training you can instantly make great music using movements familiar to you.

Becky smiling at the PhotoSynth causing it to play a melody

Becky smiling at the PhotoSynth causing it to play a melody

Commonly referred to as the Smile Powered Synthesizer due to how most people discover that their mouth now controls musical instruments.

Developed from the ground up to be accessible and inclusive, with the support and feedback from Drake Music and hundreds of disabled and differently-abled people met through #DMLabs throughout the years.

PhotoSynth being demonstrated by John Kelly playing the Contrabass preset

The PhotoSYNTH III being demonstrated by John Kelly

Constant testing with real people ensured that it evolved in an accessible and ergonomic way so that everyone can make music, alone or together with friends. With the broadest demographic covering every diversity and ability... the PhotoSYNTH levels the playing field for any aspiring creatives!

PhotoSynth being demonstrated by Louis playing the harmonic Choir preset

The PhotoSYNTH III being demonstrated by Louis from Drake Music playing the harmonic Choir preset

Looking like a magic mirror where you can see your own reflection, the PhotoSYNTH is a mixed-reality audio synthesizer that uses real-time motion capture with facial-landmark tracking to enhance your movements, and the movements of your friends, with new musical powers, controlling aspects of each instrument and sound... Finally a purpose for your reflection!

PhotoSYNTH 4D with a holographic display being tested at Electro Magnetic Fields

PhotoSYNTH 4D with a holographic display being tested at Electro Magnetic Fields

Collaboration is encouraged for up to a simultaneous quartet (four people), and whilst playing alone is a lot of fun, bringing more players adds more layers to the music and amplifies the fun considerably, where each new person can controls their favourite instrument such as the guitar, bass or drums.

A Zoom session demonstrating the PhotoSYNTH 3 in action using MIDI and an OP1 synthesizer

PhotoSYNTH III controlling an OP-1 via MIDI on a Zoom call with Tim Yates, Becky Morris-Knight and John Kelly

It is the most satisfyingly fun and psychedelic way to make music with friends, as nobody requires any skills or musical abilities and you can all just focus on the jam and rocking-out together. You can even record your performances and share them with the world!

A person demonstrating how to use the PhotoSYNTH 4D with a holographic display

Holographic version PhotoSYNTH 4D being demonstrated at the AMIC

Thanks to the #DMLab grant, there is a brand new version to share with you that contains lots of fun new features and super-powers, this time in true holographic 3D!

Online, the PhotoSYNTH can be accessed at interface.place. and you can come to the AMIC to play with the holographic version, PhotoSYNTH 4D!

PROTIP May your favourite emoji inspire your performances in order to fully maximise your enjoyment by unlocking usually hidden, secret musical superpowers.

For more information, see the #DMLab talk and its presentation, or jump straight in to the online PhotoSYNTH3.

QR code linking to the PhotoSYNTH website

History

Timeline

  1. showcased at the M.I.T. Reality Hack
  2. Presented at Beyond 2024
  3. invited to present at the prestigious IEEE 2024 for the 1st International Workshop on the Musical Metaverse.
  4. shortlisted for MIDI Innovation award.
  5. marked the release of the first holographic accessible musical instrument in the world, with the launch of the _PhotoSYNTH4D_ permanent installation at the Accessible Musical Instrument Collection AMIC. I presented a talk about the project at DMLab. The slides for that talk are also available online
  6. started working with Future Everything
  7. PhotoSYNTH4D, the holographic version, was publicly demonstrated for the first time at the Electromagnetic Fields festival '24.
  8. demonstrated live at a #DMLab event and received a grant for further development from Drake Music.
  9. an early prototype was publicly presented as an installation at the Web Audio Conference '22.
  10. PhotoSYNTH3#interFACE was featured at the MIDI Innovation Award
  11. PhotoSYNTH3#interFACE was presented at Music Maker Festival
  12. presented a talk about the PhotoSYNTH3 #interFACE at SXSW21 music technology conference titled, 'Give a man a record and they dance for day, give that man a synthesizer and they dance for a lifetime'
  13. represented the UK at Audience of the Future
  14. PhotoSYNTH3#interFACE receives Creative Industries Council's Createch “One to Watch” winner 2021
  15. PhotoSYNTH3#interFACE was first presented at the Xmas DMLab event. (Alpha version being demoed by Tim Yates from DMLab)
  16. PhotoSYNTH II was presented at the DMHackDay accessible technology contest
  17. PhotoSYNTH was presented at Music Hack Day 2011
Roadmap