- 0
- Physical game controllers required — your facial muscles are the pad
- 468
- Geometric landmark points calculated in real-time on-device
- 3
- Playable mini-games challenging rhythm, endurance, and symmetry
- 100%
- On-device edge inference with zero video frames transmitted over network
01
Wellness disguised as playful challenge.
Desk workers stare at screens for eight hours, freezing their facial posture into tense scowls. By gamifying eyebrow lifts, open-mouthed laughter, and head tilts into target-hitting mechanics, the workout happens without feeling like a chore.
02
Privacy-first edge architecture.
Cameras in software trigger privacy fears. Kao Game runs entirely within the client's browser WebAssembly runtime. Video pixels are processed in memory and immediately discarded, extracting only relative vector deltas.
03
Adaptive neutral baseline calibration.
Human faces are fundamentally asymmetrical. The system calibrates a 3-second neutral resting baseline upon launch, mapping input deltas relative to each individual's unique resting geometry.
Potential applications
- Remote work fatigue relief: A 2-minute micro-break to revitalize focus and release tension between long video calls.
- Accessible touchless interfaces: Navigation and selection mechanics for users with limited motor control or hands-busy environments.
My Contribution
- Designed the facial interaction game mechanics and scoring curves
- Engineered in-browser computer vision mesh and landmark tracking
- Developed calibration pipeline for zero-latency facial input
Research Trajectory
- Part of the ongoing "controller-free" physical interaction experiments at Creativity Is Everywhere LLC
- Exploring human wellness at the seam of play and machine perception