A Novel Augmented Reality Mobile-Based Application for Biomechanical Measurement

Human posture and range of motion (ROM) measurements are important health indicators for identifying abnormalities from various disorders (e.g., scoliosis, musculoskeletal disorders, pain syndromes). A viable real-time mobile application for measuring body posture and ROM is currently lacking. To address this need, a novel Android smartphone augmented-reality-based application was developed and evaluated to enable real-time AprilTag2 marker measurement at the point of patient contact (Biomechanical Augmented Reality-Marker, BAR-M). Mobile app performance was evaluated on a body opponent bag (BOB) and 15 healthy participants by comparing smartphone app and Vicon motion analysis output (pelvis, shoulder, arm, torso angles). A Samsung Galaxy smartphone recorded live video, calculated AprilTag orientations and angle of “a line connecting the center of two tags”, and displayed outcomes in real time. For the BOB test, the absolute difference between Vicon and smartphone angles were 0.09° ± 0.05° for hip, 0.09° ± 0.06° for shoulder, and 0.69° for arm abduction. For the participant test, the absolute mean angle differences were 1.70° ± 0.23° for hip, 1.34° ± 0.27° for shoulder, and 11.18° ± 3.68° for arm abduction. Overall, the app obtained valid and reliable angle measurements for postural and ROM assessments using the smartphone’s front camera. Arm abduction results were affected by clothing movement that caused Vicon markers to move differently from AprilTag markers. Thus, with appropriate measurement methods, this real-time smartphone app is a viable tool to facilitate immediate clinical decision making based on human posture and ROM assessments.