MOTION + DEPTH CAPTURE EXPERIMENTS
AUGMENTED REALITY DRIVEN BY FACIAL DETECTION
A custom Facebook filter uses facial detection to place a crown on the user’s head, and enable the a user to make sparkles by moving their head and butterflies by smiling.
REALTIME GAME CONTROL USING SKELETON TRACKING
Kinect to TouchDesigner to Unity pipeline allows a user to control a first-person version of Flappy Bird with their body.
REALTIME MEDIA CONTROL USING SKELETON TRACKING
Kinect to TouchDesigner pipeline.
FULL BODY MOTION CAPTURE SYSTEMS: LIMITS RESEARCH
REALTIME CHARACTER ANIMATION USING IPHONEX FACE TRACKING
Made with Unity, this experiment was limited by the quality of the 3D character’s facial skeleton.