Physio Play And Neuro Gym
XR & Spatial · iPad Clinical Rehab & Senior Cognitive Training
Markerless iPad physical rehabilitation and senior cognitive training suite powered by Google MediaPipe camera pose tracking.
- DOMAIN
- XR & Spatial
- ENGINEERING ROLE
- Computer Vision & Rehabilitation Game Engineer
- CONTEXT & PLATFORM
- iPad Clinical Rehab & Senior Cognitive Training
- TECHNICAL STACK
- Google MediaPipe · Markerless Pose Tracking · Unity iOS / iPadOS · Rehabilitation UX · C#
Key Engineering Contributions
- Integrated Google MediaPipe on iPad to track full-body and upper-limb motion via the built-in camera without wearable sensors.
- Built gamified physical rehabilitation exercises across curling (冰壺), swimming, bouldering, and posture balance training.
- Developed NeuroGym (腦有記) cognitive assessment and dementia-prevention mini-games tailored for elderly accessibility.
Feature Development: Integrated Google MediaPipe to enable iPad camera motion tracking, delivering a markerless and interactive gamified experience for PhysioPlay and NeuroGym.
UI/UX Optimization: Adjusted and optimized user interfaces to ensure seamless responsiveness and visual consistency across various device resolutions.
Code Quality & Logic: Refactored game logic and resolved critical bugs to enhance application stability and gameplay smoothness.
Performance Tuning: Identified performance bottlenecks and optimized game performance to ensure a high-frame-rate tracking experience on mobile devices.

PhysioPlay (復康樂) iPad main menu illustrating Balance Board Games (平衡板遊戲), VS Mode (對戰模式), Motion Games (動感遊戲), and Eye-Hand Mini-Games (考眼界 / 小遊戲)

PhysioPlay gamified curling (冰壺) target-ring game interface with two-player scoreboards and physics pucks on iPad

PhysioPlay 3D swimming pool race game controlled via markerless Google MediaPipe camera motion tracking on iPad

PhysioPlay markerless bouldering and rock-climbing game powered by Google MediaPipe camera body tracking with live stopwatch timer