Analysis Pipeline Overview
SportsReflector's technique analysis follows a four-stage pipeline: video capture, pose estimation, biomechanical evaluation, and score generation. Each stage introduces specific assumptions and limitations that users should understand when interpreting results.
The Four Stages
Video Capture
The athlete records a movement using the iPhone camera. Video quality, lighting, camera angle, and distance affect downstream accuracy.
Pose Estimation
A convolutional neural network detects 25+ body joint positions (keypoints) in each video frame, producing a skeletal representation of the athlete's body.
Biomechanical Evaluation
The detected joint positions are compared against sport-specific reference models to evaluate joint angles, alignment, timing, range of motion, and symmetry.
Score Generation
Weighted criteria produce a 0-100 form score along with specific correction recommendations and a confidence level indicating analysis reliability.
Pose Estimation Technology
Pose estimation is a computer vision technique that detects human body joint positions from images or video. SportsReflector tracks 25+ keypoints including major joints (shoulders, elbows, wrists, hips, knees, ankles) and additional landmarks (ears, eyes, nose, feet, hands) to reconstruct a detailed skeletal model.
The underlying models are based on architectures similar to those described in peer-reviewed research on human pose estimation. Google's MediaPipe Pose Landmarker and Carnegie Mellon's OpenPose are foundational works in this field that have demonstrated joint detection accuracy of 85-95% under controlled conditions, as reported in the COCO Keypoint Detection benchmark.
On-device processing runs on Apple's Neural Engine, enabling real-time inference without sending video to external servers. This architecture preserves user privacy — video data is processed locally and never uploaded to cloud servers for analysis.
Known Limitations
- •Occlusion: When body parts are hidden behind equipment, other limbs, or the athlete's own body, joint detection accuracy decreases. Side-angle recordings minimize this issue for most exercises.
- •Lighting: Low-light environments, strong backlighting, and high-contrast shadows reduce keypoint detection confidence. Well-lit environments produce the most reliable results.
- •Camera distance: The athlete should occupy at least 40% of the video frame for reliable full-body detection. Very distant or very close recordings reduce accuracy.
- •Clothing: Loose or baggy clothing can obscure joint positions. Form-fitting athletic wear produces the most accurate joint detection.
Scoring Methodology
Each movement receives a composite score from 0 to 100 based on multiple weighted biomechanical criteria. The specific criteria and their weights vary by sport and exercise type. For example, a squat evaluation emphasizes knee tracking, hip depth, and back angle, while a tennis serve evaluation emphasizes shoulder rotation, elbow extension, and follow-through.
Scoring Criteria Categories
| Category | What It Measures | Example |
|---|---|---|
| Joint Angles | Deviation of key joint angles from reference ranges | Knee angle at squat depth (target: 80-100 degrees) |
| Body Alignment | Relative positioning of body segments | Spine neutrality during deadlift |
| Timing | Sequencing and tempo of movement phases | Hip-shoulder separation in golf swing |
| Range of Motion | Extent of movement through the full intended path | Shoulder external rotation in tennis serve |
| Symmetry | Balance between left and right sides | Weight distribution during bilateral squat |
| Stability | Control and steadiness during movement | Knee valgus control during landing |
Score Interpretation
| Score Range | Interpretation | Recommendation |
|---|---|---|
| 0-39 | Significant form issues detected | Reduce weight/intensity, focus on fundamental movement patterns |
| 40-59 | Below average form with specific corrections needed | Address the top 1-2 corrections before progressing |
| 60-79 | Acceptable form with room for improvement | Safe to train at current intensity while refining technique |
| 80-89 | Good form with minor refinements possible | Focus on consistency and sport-specific optimizations |
| 90-100 | Excellent form across all measured criteria | Maintain current technique, consider increasing difficulty |
Reference Models and Calibration
SportsReflector's scoring is calibrated against reference models derived from multiple sources: expert athlete demonstrations, published biomechanical research, and coaching guidelines from recognized governing bodies. Each sport and exercise has a dedicated reference model that defines the acceptable ranges for each scoring criterion.
Reference models account for natural variation in body proportions. The scoring system evaluates relative joint positions and angles rather than absolute positions, so athletes of different heights, limb lengths, and body types are evaluated on the same scale. For example, squat depth is measured by hip-to-knee angle rather than absolute hip height.
Research supporting the biomechanical criteria used in SportsReflector's models includes work on optimal joint angles in resistance training and studies on biomechanical analysis of sport-specific movements published in peer-reviewed journals.
Confidence Reporting
Every analysis includes a confidence percentage that indicates how reliably the AI detected body joint positions. This is separate from the form score — a high confidence level means the AI is certain about what it detected, while the form score evaluates the quality of what was detected.
| Confidence Level | Meaning | Action |
|---|---|---|
| 85-100% | High confidence — all joints clearly detected | Form score and corrections are reliable |
| 70-84% | Moderate confidence — some joints partially occluded | Form score is approximate; re-record from a clearer angle if possible |
| Below 70% | Low confidence — significant joint detection issues | Re-record with better lighting, angle, or distance |
Validation Process
SportsReflector's scoring models are validated through comparison with expert human evaluations. For each sport and exercise, certified coaches and biomechanists independently score a set of test videos. The AI's scores are then compared against the human expert consensus to measure agreement.
This validation process is ongoing. As the app processes more movements and receives user feedback, the reference models are refined to improve accuracy and reduce edge cases where the AI's assessment diverges from expert opinion. Users can flag analyses they believe are inaccurate, and these flagged cases are reviewed during model updates.
It is important to note that even human experts do not agree perfectly on technique scores. Inter-rater reliability studies in sports coaching show that experienced coaches typically agree within 10-15 points on a 100-point scale. SportsReflector aims to fall within this same range of expert agreement.
What the Score Does Not Measure
Transparency about limitations is essential for responsible AI coaching. SportsReflector's form score evaluates observable biomechanical patterns but does not measure several important factors:
- •Internal forces: The AI cannot measure muscle activation, tendon loading, or internal joint forces. Two movements that look identical externally may involve different muscle recruitment patterns.
- •Pain or discomfort: The app cannot detect whether a movement causes pain. Athletes should not rely solely on form scores to determine exercise safety.
- •Fatigue effects: While the AI can detect form degradation over a set, it cannot measure physiological fatigue or recovery status.
- •Individual anatomy: Some athletes have structural variations (hip socket depth, spinal curvature, limb length ratios) that affect optimal movement patterns. The reference models accommodate common variation but cannot account for all individual differences.
- •Tactical context: In sports like basketball or soccer, the "correct" technique depends on game context (defender position, court spacing). The AI evaluates biomechanics in isolation.
Research References
The following published research informs SportsReflector's methodology and provides context for the accuracy and limitations of AI-powered sports analysis:
Pose Estimation Accuracy
Cao, Z., et al. "OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields." IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019. arXiv:1812.08008
MediaPipe Framework
Lugaresi, C., et al. "MediaPipe: A Framework for Building Perception Pipelines." Workshop on Computer Vision for AR/VR, CVPR 2019. arXiv:1906.08172
Biomechanical Analysis in Sport
Colyer, S.L., et al. "A Review of the Evolution of Vision-Based Motion Analysis and the Integration of Advanced Computer Vision Methods Towards Developing a Markerless System." Sports Medicine - Open, 2018. DOI: 10.1186/s40798-018-0139-y
AI in Sports Coaching
Naik, B.T., et al. "A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions." Applied Sciences, 2022. DOI: 10.3390/app12094429
Resistance Training Biomechanics
Schoenfeld, B.J. "Squatting Kinematics and Kinetics and Their Application to Exercise Performance." Journal of Strength and Conditioning Research, 2010. PubMed: 20182386