Quantitative Data Collection Flashcards
(27 cards)
What is “goodness of fit”?
Goodness of fit between:
- purpose
- design
- research question(s) or hypotheses
- conceptual and operational definitions
- data collection method
What is “data consistency”?
Following data collection protocols to ensure intervention fidelity.
Measuring the data in the same manner for each subject.
Ensures interrater reliability - consistency of observations reflected as a coefficient kappa (Cohen’s kappa).
What is “interrater reliability??
Consistency of observations reflected as a coefficient kappa (Cohen’s kappa).
What are some methods of data collection?
Physiological measurements Observational methods Interviews Questionnaires Records or available data
What is “reliability”?
The consistency with which the instrument measures the concept of interest.
What are three aspects of reliability?
Stability (test-retest reliability)
Homogeneity/internal consistency
Equivalence/Interrated reliablity (Cohen’s kappa)
What is “validity”?
The extent to which an instrument actually measures or reflects the abstract construct.
What are two measures of validity?
Expert opinion/expert panels
Comparisons to other scales, events, etc.
What is the purpose of “control” as part of quantitative design?
Measures that researches use to hold the conditions of the study uniform and avoid possible impingement of bias (extraneous variables) on the dependent variable.
What are two principles of psychometrics?
Reliability
Validity
What are some ways to have “control of extraneous variables”?
Using a homogeneous sample.
Use of consistent data-collection procedures.
Manipulation of the independent variable.
Randomization.
What is “internal validity”?
The extent to which the study findings are “true”, rather than the result of extraneous variables. (Factors from WITHIN the study design).
What is “external validity”?
The extent to which study findings can be generalized beyond the sample used in the study. (Apply findings OUTSIDE the study)
What are some internal threats to validity? (6)
History threats Maturation effects Testing effects Instrumentation threats Mortality (attrition) Selection bias
What are some external threats to validity? (3)
Selection effects
Reactive effects
Measurement effects
What are “history threats”?
History threats (internal threat) The threat to internal validity that events outside of the experimental setting may affect the dependent variable.
What are “maturation effects”?
Maturation (internal threat)
Developmental, biological, or psychological processes that operate within an individual as a function of time and are external to the events of the investigation.
What are “testing effects”?
Testing effect (internal threat) The effect on the scores of a posttest as the result of having taken a pretest.
What are “instrumentation threats”?
Instrumentation threats (internal threat) Changes in the measurement of the variables that may account for changes in the obtained measurement.
What is “mortality (attrition)”?
Mortality (attrition) (internal threat)
The loss of a subject from time 1 data collection to time 2 data collection.
What is “selection bias”?
Selection bias (internal threat) The threat to internal validity that arises when pretreatment differences exist between the experimental group and the control group.
What are “selection effects”?
Selection effects (external threat) The threat to external validity that occurs when the ideal sample population participants are either too few or unfavorable to the researcher.
What are “reactive effects”?
Reactivity (external threat)
The distortion created when those who are being observed change their behaviour because they know that they are being observed. Also known as the Hawthorne effect.
What are “measurement effects”?
Measurement effects (external threats) Changes in the generalizability of study findings to other populations, as a result of administration of a pretest.
