Chapter 4 Flashcards
(38 cards)
operationalization
The process of systematically observing some feature or characteristic of the world and then recording it in the form of a number or category
Must be able to measure theoretical concepts of interest in order to test for suspected cause and effect
Without good measurement, inference is suspect (i.e. theory testing suffers)
performance measurement
Use of measurement for administrative purposes or leadership strategy
Focuses on measuring activities outputs, and outcomes of programs, initiatives or even entire organizations
construct (trait)
Concept or thing that we seek to measure
conceptual clarity
Define characteristics and boundaries of a concept or construct of interest
Know your unti of interest (individuals? Firms? agencies?)
Know your variation of interest (over time? Between units?)
Be precise!
conceptualization
Defining carefully and precisely what it is you seek to measure
where do conceptualizations come from
Legislations, regulations, policy debates
Insurance coverage/underinsured
Management initiatives
Customer satisfaction
Academic theory
PSM
manifest constructs
Things that are factual
More directly observable than others
EX. height and weight of child
latent constructs
Things that are not easily measurable
Factors that cannot be observed directly
EX. child’s knowledge of mathematics or language arts, political ideology, self esteem etc.
proxies
A proxy measure
EX. eligibility for free school lunch is a proxy measure of the family income of students
indicators
Observable measure of an abstract construct
The tradeoff - we get to measure something abstract, usually the cost of increase error
scales and indexes
measures composed of multiple indicators
EX. Grade point average
Index formed from grades in all classes
Measures overall academic performance
validity
Extent to which your instrument measures the construct of interest
Does what you are measuring map onto the theoretical construct you intended to measure?
Assessment: is your measure of a construct related to other measures (of variables of interest) as predicted by theory?
face validity
Based on looking at measure, how well does it get at what we want to measure
(is it valid or face?)
content validity
Includes all important dimensions of the construct
Depends on whether it captures the full range of variations of construct
(does an IQ test have items covering all areas of intelligence?)
construct validity
Seeing how well our measures correspond with variables that are logically or theoretically related to the underlying construct we purport to measure
(to what extent does this questionnaire actually measure intelligence versus other related variables?)
concurrent validity
How well the measure agrees with a current measure of the same concept
predictive validity
How well the measure predicts the logical consequences
EX. job satisfaction → quitting (one year)
limitations of validity
Validity is not all or nothing
Evidence can be less than completely convincing
There is often no magic test for validity
A measure can be valid for one purpose and not another
Often validity is a matter of subjective judgment
random measurement / error noise
Random and average out to 0
Unpredictable and uncontrollable errors
EX. bathroom scale arrow bent
Systematic measurement error / bias
Errors that are systematic and on average bend the measure in a particular direction
reliability
Extent to which re-application of a measurement method produces identical values for a variable
If you cannot generate the same values for independent or dependent variables successively, confidence in results is diminished
bias
Extent to which measure is consistently off of the mark (low or high)
Can still uncover associates between IV and DV
But must be skeptical of size of descriptive and estimated relationship
test-retest reliability
Redo and get same results
interrater reliability
How similar results are from same researcher when measuring same person or object
