Research and Program Evaluation Flashcards
Research question
- relational, descriptive, causal
Quasi-experiment
- the researcher uses preexisting groups, hence the independent variable (IV) cannot be altered (example gender, age, etc). in this type of experiment, one cannot say with any degree of statistical confidence that the IV caused the dependent variable (DV)
Internal Validity
- whether the DVs were truly influenced by the experimental IVs
Threats to interval validity
- maturation of subjects, mortality (subject withdrawing), instruments used, statistical regression
External Validity
- whether the results can be generalized to a large population. e.g if the results of a study only apply to the population in the study then the external validity is low.
Chi-square
- non-parametric statistical measure that tests whether a distribution differs significantly from an expected theoretical distribution
- it’s used to determine whether an obtained distribution differs significantly from an expected distribution
Non-parametric
- only able to make a few assumptions
Factor analysis
- data reduction
Parsimony
- interpreting the results in the simplest way
Occam’s Razor
- suggests interpreting the results in the simplest manner
Bubbles
- flaws in research
Journal of Counseling Psych
- publishes more counseling research articles than any other periodical in the field
Confounding
- Occurs when an undesirable variable are not kept out of the experiment, flaw the experiment, all correlational research is said to be confounded
Basic Research
- conducted to advance our understanding of theory
Applied Research
- conducted to advance our knowledge of how theories, skills, and techniques can be used in terms of practical application.
IV
- variable research manipulates, controls
DV
- expresses the outcome of the data
Control group
- does not receive the IV (treatment)
Experimental group
- receives the IV
Ethics:
- subjects are informed of any risks
- negative after effects are removed
- allowed to withdraw at any time
- confidentiality of subjects are protected
- results reported in an accurate format
- Only use techniques you are trained in
30 people
- to conduct a true experiment
100 people
- for a survey
Organismic variable
- variable researchers cannot control yet exist. E.g: height, weight, gender, natural variable
R.A Fisher
- Hypothesis testing
- determining if the null hypothesis is to be accepted or rejected
Hypothesis
- educated guess
Research hypothesis
- testable expected relationship between two or more variables
Null hypothesis
- suggest that there will not be a significant difference between the experimental group and the control group
Meta-analysis
- study that analyzes the findings of numerous studies
Alternative hypothesis
- asserts that IV causes a change
Inferential statistical
- provide information about the population
Descriptive Analysis
- merely describe the data
T-test
- compares 2 groups
- used to ascertain whether 2 sample means are significantly different
two-tailed T-test
- non-directional experimental hypothesis
One-tailed T-test
- directional experimental hypothesis, the hypothesis specifies that one average mean is larger than the other
Between-subjects design
- when a research study uses different subjects for each condition, each subject receives only 1 values of the IV, exploring the effects of treatment between two groups.
Within-subject design
- same subjects are employed, 2 or more values/levels of the IV are administered to each subject, assess changes that occur as they experience the intervention
Parameter
- summarizes a characteristic of a population
Split-Plot design
- assess a general intervention on whole plot and other treatments to subplots within the whole
Ethnographic research
- involves information collected via interviews, observations, and the inspection of documents
P level
- level of significance/ level of confidence
- .05 on 5% chance the different between control and experimental group is due to chance factors
- .01
- .001 rules out chance levels - high confidence of less error
Type I Error (alpha)
- researchers rejects the null when it is true
- raising sample sizes lowers type 1 and 2 errors
Type II Error (beta)
- researchers accept the null when it is false
- raising sample sizes lowers type 1 and 2 errors
Anova
- more than 2 groups
- a one-way analysis of variance is used for testing one independent variable
Ancova
- analysis of covariance which tests 2 or more groups for extreme variable
Manova
- study has more than two DV
2 way Anova
- requires 2 IVs
Mancova
- involves multiple dependent variables
Correlation coefficient
- association between two variables, how a change in one is to the change in another correlation does not imply causation