Interactive application using motion data for the analysis of an individual’s musculoskeletal system

This thesis explores integrating markerless motion capture methods and gamification principles in pediatric physical and occupational therapy. The research aims to simplify the process of testing and evaluating the movement of test subjects to increase engagement and incorporate these methods into standardized medical procedures. The development involved testing various motion capture methods, emphasizing markerless capture methods using advanced computer vision technologies such as MediaPipe. This approach was complemented by developing a visual projection application that implements a portion of the MABC-2 test, which serves as an intervention method used in occupational therapy. Following a user-centered design methodology, two rounds of testing were conducted to refine and iteratively improve the proposed application. The results of testing with users indicate that the system significantly improves interaction with patients and substantially increases the effectiveness of therapeutic exercise.