MOTION + DEPTH CAPTURE EXPERIMENTS

AUGMENTED REALITY DRIVEN BY FACIAL DETECTION

A custom Facebook filter uses facial detection to place a crown on the user’s head, and enable the a user to make sparkles by moving their head and butterflies by smiling.


REALTIME GAME CONTROL USING SKELETON TRACKING

Kinect to TouchDesigner to Unity pipeline allows a user to control a first-person version of Flappy Bird with their body.

REALTIME MEDIA CONTROL USING SKELETON TRACKING

Kinect to TouchDesigner pipeline.

FULL BODY MOTION CAPTURE SYSTEMS: LIMITS RESEARCH

Ongoing.


REALTIME CHARACTER ANIMATION USING IPHONEX FACE TRACKING

Made with Unity, this experiment was limited by the quality of the 3D character’s facial skeleton.