PSY 370 Exam 2 (Uploaded) Flashcards
(47 cards)
What is test-retest reliability?
Measures consistency over time by administering the same test twice.
What is alternate forms reliability?
Measures equivalence using different versions of the same test.
What is internal consistency?
Measures how well items on a test relate to each other (e.g., Cronbach’s alpha).
What is scorer reliability?
Measures consistency between scorers (interrater/intrarater).
What does the reliability coefficient (rxx) represent?
The correlation between two sets of test scores.
What is the formula in Classical Test Theory?
X = T + E (Observed Score = True Score + Error).
What is systematic error?
Error that consistently biases results; doesn’t affect reliability.
What is a random error?
Error that varies unpredictably; reduces reliability.
How does reliability relate to confidence intervals?
Higher reliability = narrower confidence intervals for true scores.
How can we improve reliability?
Use longer tests, clear instructions, standardized conditions, and well-trained scorers.
What does validity mean in testing?
the extent to which a test accurately measures what it is intended to measure
What are the five sources of validity evidence?
Test content, response process, internal structure, relations to other variables, consequences of testing.
What is content validity?
The degree to which test items represent the construct.
What is criterion validity?
The extent to which test scores relate to external criteria.
What is construct validity?
The extent to which a test accurately measures the intended psychological concept.
What is face validity?
the degree to which a procedure appears, on the surface, to assess the inteded construct
When is evidence gathered during test development?
throughout the entire test development, starting from the initial conceptualization and continuing through pilot testing, item analysis, and ongoing psychometric analyses
How is evidence based on external criteria established?
By correlating test scores with external behaviors or performance.
What is the predictive method?
How well test scores are able to be used to predict future outcomes.
What is the concurrent method?
How well a new test or measure correlates with an exisiting, validated measure of the same construct
What is a validity coefficient?
a correlation of how well an assessment instrument predicts a specific criterion or outcome (-1 to 1)
What is the restriction of range?
when a study only examines scores from a narrow portion of the overall score distribution which potentially leads to an underestimation of the true relationship between variables
What is the mathematical relationship between reliability and validity?
a measure must be reliable to be valid, but a reliable measure isn’t necessarily valid. Validity, referring to accuracy, is a higher-order concept that requires reliability, which focuses on consistency.
What is criterion contamination?
When the criterion measure includes irrelevant or unrelated content.
