The Core Framework
Up to 90% of sports technology companies do not have independent validation studies. Only 5% of consumer wearables have been formally validated. Before investing in any technology, every organization should work through these six evaluation criteria.
1 · Needs Analysis
Understand What It Can Do For Your Team
Does it save time and help make better decisions? Do you have structure to combine the data into an athlete management system? Do you have an existing relationship with this company in another higher-revenue sport that would provide a discount?
2 · Validity & Reliability
Ask for Independent Validation Studies
If it is a new technology, ask for independent reliability and validity studies immediately. Technology may be valid for one purpose but not another. Catapult is the most validated with GPS, though accelerometers and IMUs have less reliability at higher intensities. Wearable heart rate monitors are less accurate at higher heart rate levels.
3 · Cultural Awareness
Teach Athletes the Why
Technology used to make athletes better and keep them on the court requires buy-in. Athlete education on the purpose and benefit of monitoring is as important as the technology itself. People over technology. Intervention over monitoring. Simplicity over complexity.
4 · Data Management
Do You Have Staff to Analyze and Report?
One sports scientist stated 10% should be spent on technology and 90% on data analysis. Fast models: day-to-day interaction with the athlete. Slow models: research projects in the background for quality control and validation. Do you have someone to combine all technology into a database through Excel, R, or an athlete management system?
5 · Exit Strategy
Plan Before You Buy
A clear exit strategy before purchasing — such as a commitment to use with the whole team for 3 months before evaluating. Without a defined evaluation period and success criteria, technology purchases often end up unused in a closet.
6 · Stakeholder Questions
Three Questions to Ask
Coach: How can you help me win games?
GM / Athletic Director: How can you improve my bottom line?
Athlete: How can you make me great and keep me on the court?