Watch the video below to see how the 52 blendshape values are used as a music synthesizer:

Synthesizer controlled with facial mocap data from Phiz OSC App

In this example, Pure Data is used to receive OSC data, which then controls various sine waves to play or shift their pitch.

Find the Pure Data code in the example folder of the GitHub repo.


Logo
Facial mocap from anywhere with any device