Research & Program Evaluation Flashcards
(122 cards)
Define a Type II error.
Aka. beta error
When a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false
Define a beta error.
Aka. Type II error
When a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false
What error is made when a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false?
Type II error or beta error
An experimenter wants to assess the effectiveness of a training course for improving SAT scores by comparing the pretest and posttest scores of a group of high school students. To analyze the data obtained in this study, the experimenter should use which statistical test? A. Factorial ANOVA B. Correlation C. T-test D. Chi-square
C. T-test
What statistical test should be used when comparing two means?
T-test
When should a T-test be used?
When comparing two means
Parametric and non-parametric both:
A. Assume random assignment of samples to groups
B. Assume random selection of the sample from the population
C. Require a normally-shaped distribution of DV scores in the population
D. None of the above
B. Assume random selection of the sample from the population
What is a difference between experimental and quasi-experimental research?
Random assignment is a requirement for experimental research. If you do not have random assignment, you have quasi-experimental research.
What is the difference between parametric and non-parametric statistics?
Parametric statistics make use of interval or ratio scales. Non-parametric statistics make use of nominal or ordinal scales.
You want to assess the effectiveness of a community intervention initiative aimed at educating young people about the dangers of drugs. Your assessment will most likely be a(n): A. Single subject research design B. Experimental research design C. Evaluation research design D. Longitudinal research design
C. Evaluation research design (i.e., a program evaluation)
A counselor conducted a study intended to evaluate the effectiveness of ongoing group career counseling on the vocational maturity of high school sophomores. The study was begun in September and continued until June. This study is particularly susceptible to which of the following threats to the validity of an experiment? A. Reactive effects of experimentation B. Multiple treatment interference C. Regression D. Maturation
D. Maturation
A counselor designs a study where two experimental groups and one control group complete pre- and post-experiment measures of self-concept. The subjects were not randomly assigned to the groups because of scheduling problems. Which of the following techniques is MOST appropriate for analyzing the resultant data?
A. Correlated t-tests
B. Wilcoxon matched-pairs signed-ranks test
C. Analysis of covariance
D. Analysis of variance
C. Analysis of covariance
A researcher conducts a study to test the hypothesis that children who eat food with a lot of sugar are more hyperactive than children who eat food with no sugar. The study’s independent variable is ____ and its dependent variable is ____:
A. Type of children; level of sugar consumed
B. Level of aggressiveness; level of sugar consumed
C. Level of sugar consumed; level of hyperactivity
D. Level of hyperactivity of children before eating; level of hyperactivity of children after eating
C. Level of sugar consumed; level of hyperactivity
Define independent variable.
The variable that is hypothesized to bring about or predict change in the dependent variable
The scale of measurement that is characterized by an arbitrary zero point is: A. Ordinal B. Ratio C. Nominal D. Interval
D. Interval
Name the four scales of measurement.
- Nominal
- Ordinal
- Interval
- Ratio
Describe the nominal scale of measurement.
It divides variables into unordered categories
Describe the ordinal scale of measurement.
It divides variables into categories and also provides information on the order of those categories
Describe the interval scale of measurement.
Characterized by equal intervals between data points, but no absolute zero. For example, in the Fahrenheit temperature scale, zero degrees does not mean that there is absolutely no heat. Thus the zero point is arbitrary rather than absolute.
Describe the ratio scale of measurement.
Has the properties of order and equal intervals as well as the property of an absolute zero point
When assessing the effect of a pretest on the dependent variable in an experiment, which research design should you use? A. Counterbalanced design B. ABA design C. Solomon four-group design D. ABAB design
C. Solomon four-group design
Define the Solomon four-group design.
An experimental design used to control the effects of pretesting on both the internal and the external validity of a research study by including the pretest as an independent variable
You are hired by a large insurance company to help improve sales. Two groups of employees are given a motivational pep talk that is either direct or indirect. Three groups are given either high doses, moderate doses, or low doses of a new drug designed to increase the performance of salespeople. Two groups attend a class in sales techniques that is taught either by an educator or an experienced salesperson. Afterwards, all subjects take a test of attitudes towards their jobs and all of their sales, in dollar amounts, are compared to previous levels. Which of the following is an independent variable in this study? A. Sales in dollar amounts B. Qualifications of the teacher of the class C. Low dosage of the drug D. Method for improving sales performance
B. Qualifications of the teacher of the class
MANOVA is a statistical technique that is used in situations where:
A. There are multiple independent variables, each with multiple levels
B. There are multiple dependent variables and any number of independent variables
C. There are multiple dependent variables and only one independent variable
D. There are multiple dependent variables and multiple independent variables
B. There are multiple dependent variables and any number of independent variables