L2 Flashcards
(39 cards)
5 methodological issues in experiments
reliability, file-drawer problem, validity, WEIRD subjects, experimenter bias
Reliability
consistent results across multiple occasions, with different experimenters, across different labs/field sites
Inter-rater reliability vs test-retest reliability
- different raters, same results
- same kid, different time, same results
File-drawer problem
many studies don’t get published and sit in (virtual) file drawers as positive results are more likely to get published
Validity
having a measure that accurately reflects the process or construct of interest
e.g. looking time and preference
Internal validity
whether the observed effects can be attributed to what you’re measuring (dependent variable) and your manipulation (independent variable) without a confound
External/ecological validity
whether or not the findings are generalizable to the general population (real world) or just the sample (lab)
Potential solution to the WEIRD bias
ManyBabies projects where dozens or hundreds of labs around the world do the same study, estimate the size of the effect, and probe cross-cultural differences
Attrition issues in infant studies
babies leaving the sample
2 necessary conditions in conducting infancy research
measurement equivalence and control for everything to prevent confounds (e.g. parental influence)
measurement equivalence: the same construct is being measured across groups or across time
Examples of recruitment methods in infancy research
birth records, hospital recruitment, buying mailing lists, facebook ads, posting flyers
5 kinds of research designs
correlation, experiment, quasi-experiment, naturalistic observation, structured observation
Correlation
values on 2 or more variables are observed and the relationship between them is assessed
Benefits and limitations of correlational design
- can evaluate the direction and strength of the relationship between variables that may even be impossible or unethical to manipulate
- cannot draw causal conclusions (direction-of-causation problem) and third-variable problem
Experiment
- participants are randomly assigned to conditions or groups
- experimenter manipulates the independent variable/s and measures the dependent variable/s
Benefit vs limitation of experimental design
can make causal conclusions but some variables cannot be manipulated
Between-subjects vs within-subjects experiments
- comparison between experimental group and control group
- each subject gets both experimental and control items
Which kind of experimental design has more statistical power?
within-subjects
because individual differences are eliminated
Quasi-experimental designs
natural variables (e.g. sex, age, SES) are treated as groups so members are not randomly assigned
Limitations of quasi-experimental designs
- essentially correlational so difficult to conclude causality as third variables may be in play
- need to ensure groups match as closely as possible on other variables
2 main designs for studying development (change over time)
Cross-sectional vs longitudinal design
- groups of different children of different ages are compared
- the same children are examined over time at different ages (collected at intervals of months or years)
Benefits and limitations of cross-sectional design
- relatively fast and requires less commitment from families
- statistically less powerful due to potential individual differences and cohort differences
cohort differences: age differences are confounded with group differences
Microgenetic design
type of longitudinal design wherein the same children are observed repeatedly after short intervals (e.g. daily, weekly) over a relatively short time period as they master a task (e.g. onset of crawling, first word learning)
Benefits vs limitations of longitudinal design
- better information on developmental change and individual differences are not as influential
- expensive, time-consuming, cohort effects are masked, test-retest issues (e.g. practice effects)