Statistics And Research Design - Domain Quiz Flashcards
A research participant is instructed to “think aloud” while solving complex geometry problems in order to identify the thought processes that underlie successful and unsuccessful problem-solving. The participant’s verbalizations will be recorded and analyzed. This technique is known as:
Select one:
a. event sampling.
b. protocol analysis.
c. situational sampling.
d. sequential analysis.
In this situation, information about the participant’s cognitive processes is being obtained.
Answer B is correct: Protocol analysis is also referred to as the “think aloud” exercise and is used to obtain information about cognitions associated with a particular type of problem or other phenomenon.
Answer A is incorrect: Event sampling is a type of behavioral sampling that involves observing and recording information about a behavior when it occurs (e.g., observing a conflict between group therapy members).
Answer C is incorrect: Situational sampling involves observing a behavior in multiple settings.
Answer D is incorrect: Sequential analysis is used to encode behavioral sequences and is useful for studying complex social behaviors.
The correct answer is: protocol analysis.
Cluster sampling involves:
Select one:
a. randomly selecting individuals from pre-defined groups in the population that are relevant to the research hypothesis.
b. randomly selecting individuals who have been identified as belonging to the target groups.
c. randomly selecting pre-existing groups of individuals from the population.
d. randomly assigning pre-existing groups to different levels of the independent variable.
As its name suggests, cluster sampling involves selecting clusters (groups) of individuals from the population.
Answer C is correct: When using cluster sampling, pre-existing groups are randomly selected from the population (e.g., schools, mental health clinics) and all individuals in each group or a random sample of participants in each group are included in the study.
Answer A is incorrect: This answer describes stratified random sampling.
Answer B is incorrect: See explanation for Answer C.
Answer D is incorrect: See explanation for Answer C.
The correct answer is: randomly selecting pre-existing groups of individuals from the population.
Interval recording is most useful for:
Select one:
a. studying behaviors that have no fixed beginning or end.
b. studying behaviors that have a long duration.
c. obtaining a detailed narrative description of a behavior.
d. identifying the antecedents and consequences of a behavior.
Interval recording is a method for sampling and recording the frequency of a behavior.
Answer A is correct: Interval recording is a type of time sampling that involves recording whether or not a behavior occurred during each interval of time. It is useful for behaviors that have no clear beginning or end.
The correct answer is: studying behaviors that have no fixed beginning or end.
Scores on an extraneous variable:
Select one:
a. correlate with scores on the dependent variable.
b. correlate with scores on the independent variable.
c. correlate with scores on the dependent and independent variables.
d. do not correlate with scores on the dependent or independent variable.
By definition, an extraneous variable correlates with (has a systematic effect) on the dependent variable.
Answer A is correct: Extraneous variables are irrelevant to the purpose of a research study but confound its results because they correlate with the dependent variable, which makes it difficult to identify the effects of the independent variable on the dependent variable. Additional information about extraneous variables is provided in the Statistics and Research Design chapter of the written study materials.
The correct answer is: correlate with scores on the dependent variable.
The primary characteristic that distinguishes true experimental research from quasi-experimental research is that, in the former:
Select one:
a. participants are randomly selected from the population.
b. participants are randomly assigned to treatment groups.
c. the levels of the independent variable are systematically selected.
d. a parametric statistical test can be used to analyze the data.
Answer B is correct: For the exam, you want to be sure you understand the difference between random selection (sampling) and random assignment so that you can answer questions like this one. The “hallmark” of true experimental research is the ability to randomly assign participants to treatment groups, which helps ensure that groups do not differ in a systematic way at the beginning of the study.
Answer A is incorrect: See explanation for Answer B.
Answer C is incorrect: In some cases, levels of the IV may also be “systematically selected” in quasi-experimental research.
Answer D is incorrect: The choice of a parametric or nonparametric statistical test depends on the nature of the data, not the type of study.
The correct answer is: participants are randomly assigned to treatment groups.
To assess the effects of a stimulus control procedure on eating behaviors, Dr. Barry Buvette obtains a sample of 20 overweight females and 20 overweight males and determines their average daily caloric intake and satisfaction with their food consumption during the seven days before and seven days after training in the procedure. The dependent variable(s) in this study is or are:
Select one:
a. stimulus control procedure.
b. stimulus control procedure and gender.
c. caloric intake.
d. caloric intake and satisfaction with food consumption.
In this study, the researcher is investigating the effects of the self-control procedure and gender on caloric intake and satisfaction with food consumption.
Answer D is correct: This study has two dependent variables – caloric intake and satisfaction with food intake. See the Statistics and Research Design chapter for information on independent and dependent variables and how to distinguish between them.
Answer A is incorrect: See explanation for Answer D.
Answer B is incorrect: Stimulus control procedure and gender are both independent variables in this study.
Answer C is incorrect: See explanation for Answer D.
The correct answer is: caloric intake and satisfaction with food consumption.
When using the technique known as blocking:
Select one:
a. an extraneous variable is “held constant.”
b. the effects of an extraneous variable are statistically removed.
c. an extraneous variable is treated as an independent variable.
d. an extraneous variable is treated as a dependent variable.
Answers A, B, and C all describe methods for controlling an extraneous variable but only one describes the method known as blocking. Additional information about controlling extraneous variables is provided in the Statistics and Research Design chapter of the written study materials.
Answer C is correct: This answer describes blocking which allows a researcher to evaluate the main and interaction effects of the extraneous variable.
Answer A is incorrect: Holding the extraneous variable constant is one method of control but this is not referred to as blocking.
Answer B is incorrect: This is another way to control an extraneous variable but is not referred to as blocking.
Answer D is incorrect: When using blocking, the extraneous variable is treated like an independent (not dependent) variable.
The correct answer is: an extraneous variable is treated as an independent variable.
An interviewer unintentionally nods whenever research participants answer his questions in ways that confirm the study’s research hypothesis. The interviewer’s behavior is best described as an example of which of the following?
Select one:
a. demand characteristics
b. Hawthorne effect
c. halo effect
d. instrumentation
Experimenter expectancy is the term used to describe the ways in which an experimenter may bias the result of a research study.
Answer A is correct: In the situation described in this question, the interviewer’s expectancies are acting as a source of demand characteristics – i.e., the interviewer is giving information to participants that lets them know what behavior is expected of them.
The correct answer is: demand characteristics
A psychologist evaluates the effects of a 15-month training program on the conservation skills of preoperational children by administering a measure of conservation to the same group of children before and at the end of training. The psychologist finds that significantly more children are able to conserve after the program than before the program. The biggest threat to this study’s internal validity is:
Select one:
a. maturation.
b. history.
c. instrumentation.
d. statistical regression.
For the exam, you want to be familiar with all of the threats listed in the answers to this question. Information about them is provided in the Statistics and Research Design chapter of the written study materials.
Answer A is correct: In the situation described in this question, any change in ability to conserve could be due to normal development (maturation) over the 15-month period rather than to the effects of the training program.
The correct answer is: maturation.
A psychologist obtains a statistically significant F-ratio for the interaction between two independent variables (IVs). This means that:
Select one:
a. the effects of one IV are significant across all levels of the second IV.
b. the effects of one IV are contingent on the level of the second IV.
c. the main effects of both IVs are statistically significant.
d. the effects of the two IVs are statistically significant only when they are considered jointly.
Answer B is correct: This answer is another way of saying that the effects of one IV are different at different levels of the other IV, which is the definition of an interaction.
The correct answer is: the effects of one IV are contingent on the level of the second IV.
As applied to research design, “external validity” refers to which of the following?
Select one:
a. accuracy
b. control
c. significance
d. generalizability
Both internal and external validity are concerns in the design of research. Internal validity refers to the extent to which it can be assumed that the changes in the dependent variable are caused by the independent variable. External validity refers to the extent to which the results of a research study can be generalized.
Answer D is correct: External validity refers to the researcher’s ability to generalize research findings beyond the specific time, setting, and participants involved in the research study.
The correct answer is: generalizability
Dr. Angela Angst is using a repeated measures design to compare the effects of different techniques for reducing free-floating anxiety. To control potential carryover effects, Dr. Angst should use which of the following?
Select one:
a. an unobtrusive measure
b. blocking
c. counterbalancing
d. a cross-sequential design
Carryover effects occur when being exposed to one level of the independent variable affects how a participant reacts to another level of that variable. It is a potential threat to the validity of repeated measures designs in which each participant is exposed to more than one level of the independent variable.
Answer C is correct: Counterbalancing controls carryover effects by presenting the different levels of the independent variable to different participants in a different order.
The correct answer is: counterbalancing
In which of the following types of research studies do participants act as their own “controls”?
Select one:
a. cross-sectional
b. factorial
c. analogue
d. single-subject
For participants to act as their own controls, each participant would have to participate in both treatment and no-treatment groups. This occurs in only one of the designs listed in the answers.
Answer D is correct: All single-subject designs include at least one baseline (no treatment) phase and one treatment phase. Consequently, when using a single-subject design, a participant acts as his or her own no-treatment control (i.e., the participant’s status on the dependent variable is compared before and after the treatment is applied).
The correct answer is: single-subject
The Solomon four-group design is used to control which of the following threats to the validity of a research study?
Select one:
a. statistical regression
b. pretest sensitization
c. reactivity
d. maturation
When using the Solomon four-group design, the pretest is treated as an additional independent variable so that its effects on the dependent variable can be statistically analyzed.
Answer B is correct: When using the Solomon four-group design, the effects of administering a pretest on the study’s internal and external validity can be identified.
The correct answer is: pretest sensitization
According to the Central Limit Theorem, the shape of the sampling distribution of means:
Select one:
a. is always normal.
b. is normal only when the population distribution of scores is normal.
c. approaches normal as the number of samples increases regardless of the shape of the population distribution of scores.
d. approaches normal as the size of the samples increases regardless of the shape of the population distribution of scores.
For the exam, you want to be familiar with the three predictions made by the Central Limit Theorem about the sampling distribution. These are discussed in the Statistics and Research Design chapter of the written study materials.
Answer D is correct: The Central Limit Theorem predicts that the sampling distribution increasingly approaches normal as the sample size (not the number of samples) increases.
The correct answer is: approaches normal as the size of the samples increases regardless of the shape of the population distribution of scores.
A researcher will use trend analysis to analyze the data she has collected in a research study when:
Select one:
a. the research design is quasi-experimental.
b. the dependent variables are correlated.
c. the independent variable is quantitative.
d. the research design is longitudinal.
For the exam, you want to be familiar with trend analysis as well as with the other forms of the ANOVA that are described in the written study materials.
Answer C is correct: Trend analysis is a type of analysis of variance that can be used when the independent variable is quantitative. It allows the researcher to determine whether there is a significant linear or nonlinear effect of the independent variable on the dependent variable.
The correct answer is: the independent variable is quantitative.
A researcher would use a multivariate analysis of variance (MANOVA) to analyze the data she collects in a study when:
Select one:
a. the study includes one or more independent variables and two or more dependent variables.
b. the study includes three or more independent variables and a single dependent variable.
c. she wants to statistically remove the effects of an extraneous variable.
d. she wants to statistically analyze the main and interaction effects of an extraneous variable.
The MANOVA is used when a study includes two or more dependent variables.
Answer A is correct: When all dependent variables are measured on an interval or ratio scale, a researcher can use the MANOVA rather than separate ANOVAs to evaluate the effects of the independent variable on the dependent variables. Doing so helps reduce the experimentwise error rate.
Answer B is incorrect: A factorial ANOVA would probably be the appropriate test in this situation if the dependent variable is measured on an interval or ratio scale.
Answer C is incorrect: The ANCOVA is used to statistically remove the effects of an extraneous variable.
Answer D is incorrect: The randomized block ANOVA is used to statistically analyze the effects of an extraneous variable when that variable is being treated as an independent variable.
The correct answer is: the study includes one or more independent variables and two or more dependent variables.
Dr. Terry Tas obtains SAT scores from a sample of 30 high school seniors following their participation in a workshop designed to improve SAT scores. The appropriate statistical test for comparing the mean score obtained by these students to the national mean is which of the following?
Select one:
a. t-test for a single sample
b. t-test for independent samples
c. one-way ANOVA
d. Wilcoxon test
The analysis of the data collected in this study will involve comparing a sample mean to a known population mean.
Answer A is correct: The different forms of the t-test are all used to compare two means, and the t-test for a single sample is used when a sample mean will be compared to a known population mean.
Answer B is incorrect: The t-test for independent samples is used to compare means obtained from two independent groups (samples).
Answer C is incorrect: The one-way ANOVA is used to compare means obtained from two or more independent groups.
Answer D is incorrect: The Wilcoxon Matched-Pairs test is used to compare the ranks obtained from two correlated (matched) groups.
The correct answer is: t-test for a single sample
The standard error of the mean (SEM) decreases as:
Select one:
a. the population standard deviation increases and the sample size increases.
b. the population standard deviation increases and the sample size decreases.
c. the population standard deviation decreases and the sample size decreases.
d. the population standard deviation decreases and the sample size increases.
Knowing the formula for the standard error of the mean would have helped you identify the correct answer to this question.
Answer D is correct: The standard error of the mean is equal to the population standard deviation divided by the square root of the sample size. Plugging numbers into this formula proves that the standard error decreases in size as the population standard deviation (numerator) decreases and or or the sample size (denominator) increases. See the Statistics and Research Design chapter of the written study materials for examples of the effects of changing the standard deviation and sample size on the size of the standard error of the mean.
The correct answer is: the population standard deviation decreases and the sample size increases.
Ninety adults are randomly assigned to one of three groups and the average IQ score of each group is calculated. If a one-way ANOVA is used to compare the mean IQ scores of the three groups, you would expect the resulting F-ratio to be:
Select one:
a. equal to 0.
b. equal to 1.0.
c. greater than 100.
d. equal to -1.0
The F-ratio is calculated by dividing a measure of variability due to error plus treatment (mean square between) by a measure of variability due to error only (mean square within).
Answer B is correct: When there are no treatment effects (which would be the case in the situation described in this question), the numerator and denominator should both be measures of error and the F-ratio will simply be error divided by error, which should equal a value very close to 1.0.
The correct answer is: equal to 1.0.
The chi-square test would NOT be the appropriate test for analyzing data collected from which of the following studies?
Select one:
a. a study conducted to determine if there is a difference in the number of males and females who either support, do not support, or have no opinion about gun legislation
b. a study conducted to compare the number of males and females who say they prefer paper, plastic, or hemp bags for their groceries before and after they view a film on recycling
c. a study conducted to determine if there is any difference in the proportion of people who have received a diagnosis of Bipolar Disorder - Mixed, Bipolar Disorder - Manic, or Bipolar Disorder - Depressed who have either one parent, both parents, or neither parent with an Affective Disorder
d. a study conducted to compare the number of shoppers who say they prefer one of four different cleaning products
The chi-square test is used when the data to be analyzed represent a nominal scale of measurement (i.e., the frequencies in each nominal category will be compared) and when certain assumptions are met.
Answer B is correct: One of the assumptions for the chi-square test is independence of observations. In the study described in this answer, the preferences of each participant will be determined twice (before and after viewing the film) and, consequently, the assumption of independence is violated.
Answer A is incorrect: The multiple-sample chi-square test would be the appropriate test for analyzing data collected in this study.
Answer C is incorrect: The multiple-sample chi-square test would be the appropriate test for analyzing the data collected in this study.
Answer D is incorrect: The single-sample chi-square test would be the appropriate test for the study described in this answer.
The correct answer is: a study conducted to compare the number of males and females who say they prefer paper, plastic, or hemp bags for their groceries before and after they view a film on recycling
The t-test for dependent samples is used to analyze the data collected in a study involving 36 participants who had been matched on an extraneous variable before being assigned to one of the two treatment groups. The degrees of freedom for this study are:
Select one:
a. 36
b. 35
c. 18
d. 17
The degrees of freedom for the t-test for dependent (correlated) samples is equal to N - 1, where N is the number of pairs of scores.
Answer D is correct: In this study, there are 18 pairs of scores, so the degrees of freedom are (18 - 1), or 17.
The correct answer is: 17
The t-test for dependent samples is used to analyze the data collected in a study involving 36 participants who had been matched on an extraneous variable before being assigned to one of the two treatment groups. The degrees of freedom for this study are:
Select one:
a. 36
b. 35
c. 18
d. 17
The degrees of freedom for the t-test for dependent (correlated) samples is equal to N - 1, where N is the number of pairs of scores.
Answer D is correct: In this study, there are 18 pairs of scores, so the degrees of freedom are (18 - 1), or 17.
The correct answer is: 17
For children with ADHD, an academic achievement test has a mean of 40 and a standard deviation of 8. Assuming that the distribution of scores is normally shaped, you can conclude that 16% of these children obtained scores below a score of:
Select one:
a. 24
b. 32
c. 40
d. 48
For the exam, you want to be familiar with the areas under the normal curve so that you can answer questions like this one.
Answer B is correct: In a normal distribution the score that is one standard deviation below the mean divides the distribution so that 16% of cases fall below that score and the remaining 84% fall above it. In this distribution, a score of 32 is one standard deviation below the mean.
The correct answer is: 32