Two-hand camera mode
Allow camera access, place both hands in the frame and keep them well lit. The left hand selects harmony while the right hand shapes the sound.
GESTURE SYNTH
A browser instrument
Live hand tracking synthesizer
Make a song
with your hands.
Choose a chord.
Shape the energy.
Change the tone.
Shape the energy.
Change the tone.
Play
Ekmand gesture engine
Put both hands in the frame.
Left hand chooses harmony. Right hand shapes voicing, loudness, tone and octave. Camera frames stay in this browser.
Gesture Synth guide
A musical instrument for movement.
Gesture Synth turns your webcam into a browser-based music instrument. Keep both hands in the frame and explore harmony, pitch and expression through movement.
Left hand: choose harmony
Hold up one to four fingers to choose a scale degree. Tilt the left hand inward or outward to move between major and minor color.
Right hand: shape expression
One to four fingers choose voicing and inversion. Move the right hand higher for more loudness, tilt it to sweep the filter, and move the thumb in or out to change octave.
Built for two hands
Keep both hands visible for the full instrument: harmony on the left, voicing and expression on the right.
Browser and privacy
Current Chrome and Edge on desktop provide the best camera, WebAssembly and Web Audio support. Camera frames and hand landmarks are processed in this browser session.
FAQ
Before you play.
Everything you need to know about camera access, browser audio and privacy.
View all FAQDo I need a webcam?+
Yes. Two-hand Camera Mode uses your webcam to track both hands and turn gestures into sound.
Is my camera video uploaded?+
No. Hand landmarks are processed in the browser session. Camera frames are not uploaded as part of the instrument.
How do I control pitch and loudness?+
The right hand controls expression: height changes loudness, fingers change voicing, tilt changes tone, and the thumb lowers the octave.