Musical Emotion

This is an interactive website using facial detection. Music will react to your emotion. Each emotion has a different instrument. When it detects you are happy you will hear the sound of a harp and when you’re angry you’ll hear a drum. You can see the data visualisation under the video.

I use Tone.js to create the sound. I used JavaScript library clmtrackr for facial detection.

This is a fun and easy interactive website that anyone can engage with. Even though someone may not understand music, anyone can use their face to create music.

The website is avaliable here. Try it yourself!