Physio Play And Neuro Gym

XR & Spatial · iPad Clinical Rehab & Senior Cognitive Training

Markerless iPad physical rehabilitation and senior cognitive training suite powered by Google MediaPipe camera pose tracking.

DOMAIN
XR & Spatial
ENGINEERING ROLE
Computer Vision & Rehabilitation Game Engineer
CONTEXT & PLATFORM
iPad Clinical Rehab & Senior Cognitive Training
TECHNICAL STACK
Google MediaPipe · Markerless Pose Tracking · Unity iOS / iPadOS · Rehabilitation UX · C#

Key Engineering Contributions

  • Integrated Google MediaPipe on iPad to track full-body and upper-limb motion via the built-in camera without wearable sensors.
  • Built gamified physical rehabilitation exercises across curling (冰壺), swimming, bouldering, and posture balance training.
  • Developed NeuroGym (腦有記) cognitive assessment and dementia-prevention mini-games tailored for elderly accessibility.
  • Feature Development: Integrated Google MediaPipe to enable iPad camera motion tracking, delivering a markerless and interactive gamified experience for PhysioPlay and NeuroGym.

  • UI/UX Optimization: Adjusted and optimized user interfaces to ensure seamless responsiveness and visual consistency across various device resolutions.

  • Code Quality & Logic: Refactored game logic and resolved critical bugs to enhance application stability and gameplay smoothness.

  • Performance Tuning: Identified performance bottlenecks and optimized game performance to ensure a high-frame-rate tracking experience on mobile devices.

PhysioPlay (復康樂) iPad main menu illustrating Balance Board Games (平衡板遊戲), VS Mode (對戰模式), Motion Games (動感遊戲), and Eye-Hand Mini-Games (考眼界 / 小遊戲)

PhysioPlay (復康樂) iPad main menu illustrating Balance Board Games (平衡板遊戲), VS Mode (對戰模式), Motion Games (動感遊戲), and Eye-Hand Mini-Games (考眼界 / 小遊戲)

PhysioPlay gamified curling (冰壺) target-ring game interface with two-player scoreboards and physics pucks on iPad

PhysioPlay gamified curling (冰壺) target-ring game interface with two-player scoreboards and physics pucks on iPad

PhysioPlay 3D swimming pool race game controlled via markerless Google MediaPipe camera motion tracking on iPad

PhysioPlay 3D swimming pool race game controlled via markerless Google MediaPipe camera motion tracking on iPad

PhysioPlay markerless bouldering and rock-climbing game powered by Google MediaPipe camera body tracking with live stopwatch timer

PhysioPlay markerless bouldering and rock-climbing game powered by Google MediaPipe camera body tracking with live stopwatch timer