L9 - Validity Flashcards
(16 cards)
What is construct validity?
The extent to which you’re measuring the intended construct.
What is content validity?
How well you’re measuring all aspects of the construct.
Why is validity important in performance analysis?
Because performance is directly observable, but the importance and representation of a variable depend on expert judgement (e.g., coach or analyst).
What is reliability in performance analysis?
How consistently a measurement procedure can be applied.
What is intra-rater reliability?
The consistency of measurements made by a single analyst.
What is inter-rater reliability?
The consistency of measurements made by multiple analysts.
What is objectivity in performance analysis?
The extent to which measurements are free from bias, often supported by clear operational definitions.
How do operational definitions affect validity and reliability?
Clear definitions improve both validity and reliability. For example, deciding if passes must be intentional or leaving some definitions to analyst discretion.
How does video quality affect reliability?
High vantage points, zooming in during slower movements, and zooming out/panning during fast movements help capture detail and improve reliability.
What is the purpose of error checking in live coding?
To catch mistakes. This includes using an error button and checking for logical consistency (e.g., alternating centre passes in netball).
Name some reliability (agreement) statistics used in analysis.
Mean difference, percent difference, kappa statistic, and others.
What does the kappa statistic assess?
Agreement on specific events between observers, adjusted for chance agreement.
What does accuracy mean in measurement?
How close the average measurement is to the true (criterion) measurement.
What is a Gold Standard in measurement?
The method considered closest to the true value, used as a benchmark for accuracy.
What is sensitivity or precision in measurement?
The extent to which small changes can be detected; reported precision should match the precision of the measurement method.
What do Bland-Altman plots assess?
Agreement across a measurement range by plotting:
Y-axis: paired differences
X-axis: mean of paired measurements
