Reliability Flashcards
What is ICC 1 measuring?
test-retest reliability (reliability of data)
What test do we use to analyze ICC 1
one way anova
What is ICC 2 measuring?
INTER rater reliability (reliability of a clinical tool)
What test do we use to analyze ICC 2?
two way ANOVA
What is ICC 3 measuring?
INTRA rater reliability (reliability of raters between trials)
What test do we use to analyze ICC 3?
mixed model ANOVA
what can influence reliability
restrictions in range, interaction between raters and subjects, response stability
What criteria needs to be met for weighted Kappa stats?
ordinal data, and a large sample size
What is standard error of measurement?
the variability of an individuals tests scores due to random measurement error. Think of it as SD for an individual
what are the 4 factors affecting power?
significant level (alpha), variance in data (inclusion criteria), effect size (dosage of exercise), sample size (n)
can we influence the factors that affect power?
yes, all 4
as type 1 error decreases, type 2 error _________
increases
when must you determine sample size?
a priori (before experiment)
how do we determine effect size if it is not known?
guess, estimate from the literature, pilot studies, determine what would be a clinically meaningful difference and base numbers on that
what is considered a large effect size with a t test?
above .8
