Week 10: Measurement Error Flashcards
(33 cards)
Measurement error
The difference between the observed score and the true score
List some sources of measurement error
- the test, if it is poorly designed
- the test taker and how they are feeling on the day
- the testing environment
- cultural factors e.g. language understanding
Standard error of measurement
Provides the necessary information for assessing the measurement error associated with an individuals test performance. How far the mean from a sample is from the true mean of the population
List in order the test development process
- conceptualisation
- construction
- tryout
- analysis
- revision
Conceptualisation
How do you define a test? What are you measuring? What is useful and what is outside the bounds of this?
Construction
Essentially developing the items, and considering why items are important for the test
Tryout
Collecting test data and qualitative feedback on the test
How is best to measure knowledge
Yes/no, multiple choice, short answer
How is best to measure degree of symptoms/attitudes
Likert scale
How is best to measure health
Visual analogue scale
How is best to measure neurological function?
- visual items
- memory
- visuospatial tasks
How is best to measure personality?
Q-sort
List some important considerations when designing a test
- generate an item pool
- short and concise items
- age appropriate level
- no double barrelled items
- include negatively worded items
Dichotomous
Two answers; Yes/no, true/false
Polytomous
More than 2 alternatives, like a multiple choice
Likert
Typically 5 items ranging from strongly disagree to strongly agree
Likert type format
“Never”, “rarely”, etc.
Q-sort
Cards with descriptions that need to be sorted via categories. Can be useful for clients but not for large samples.
Describe semantic differential
Where a person falls between two opposing poles by marking a line
Describe visual analogue
Indicating where you fall on a line
Benefits of reverse scored items
Bias is controlled for and requires extra concentration from participants
Category format
e.g. ‘On a scale from 1-10..’
Some characteristics of category format
- has situational effects
- need clearly defined endpoints
- increasing categories above 10 can decrease reliability
Classical test theory
- true score = observed score + error
- interested in total scores, of which one proportion is error and one proportion is true scores
