767 Flashcards

Learn to be a scientist!

1
Q

How does science differ from a layperson’s approach to science?

A
  1. We are explicit in what we’re doing and why we’re doing it. 2. We make a fundamental distinction between observations and inferences. 3. REPLICATION
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What’s the difference between observations and inferences?

A

Observation is the data collected. Inferences are anything else, including results (e.g. tentative conclusions, abstractions about reality, putting words to concepts)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How does the scientific model apply to clinical work?

A
  1. Think scientifically 2. Check inferences 3. Identify and be explicit about assumptions we make 4. The goal is to be value-explicit, not value-free
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why should I become aware and explicit of my worldview and assumptions?

A

The alternative of being explicit and conscious is the risk of imposing values on others and making inaccurate assumptions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Why do we live in an inductive world in Psychology?

A

There are no steadfast rules. Must infer from the data we collect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the central problem of inductive science?

A

Error. All samples have error. Our efforts are all aimed at reducing this error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the aim of science?

A

Theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the relevance of the stocastic model to clinical work?

A

Clients present a sample of their behavior from the population of their experiential world. We must recognize that this is limited, not impose our worldviews, and attempt to understand from multiple vantage points (different theories)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are Mike Ellis’ current 8 steps of scientific research methods?

A
  1. Identify/observe phenomenon 2. Formulate problem. 3. Explicate theorizing. 4. Research hypothesis. 5. Empirical test. 6. Data analysis.7. Interpretation. 8. Revise theory and retest.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the impact of paradigms in scientific inquiry?

A

They affect how we: 1. Construct theory 2. Explain what happens 3. Choose phenomenon to observe and ignore 4. Identify patterns 5. Identify what counts as data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the rules of categorization (partitioning)?

A
  1. Categories must be set up according to the research problem. 2. Exhaustive 3. Mutually exclusive and independent 4. Each category (variable) is derived from one classification principle 5. Any categorization scheme must be on one level of discourse
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why should I graph my data?

A

Shows relations and their nature. Can show things you would miss with simple statistics (e.g. bimodal data)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What might cause negative results?

A
  1. Incorrect theory and hypotheses 2. Inappropriate or incorrect methodology 3. Inadequate or poor measurement 4. Faulty analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the core procedure of statistical analysis?

A
  1. Set up chance expectation as hypothesis (null hypothesis) 2. Try to fit empirical data to chance model 3. If empirical data fit chance model, they are not statistically significant. If data do not fit chance model, they are statistically significant
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the law of large numbers?

A

With an increase in the size of sample, n, there is a decrease in the probability that the observed value of an event, A, will deviate from the true value of A by no more than a fixed amount, k. (Reduction of errors)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are characteristics of the normal curve?

A
  1. Unimodal 2. Symmetrical 3. Possesses certain mathematical properties
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is Popper’s major contribution to scientific inquiry?

A

Falsificationism!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the key principle of falsificationism?

A

Aim to disprove, not prove, theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are Jon Stewart Mill’s five methods of elimination?

A
  1. Method of agreement (constant conjunction) 2. Method of differences (absence of cause or absence of effect) 3. Method of joint agreement of differences (basis for control group vs. experimental group) 4. Method of residuals (notion of error) 5. Method of concomitant variance *look at how variables vary together if can’t manipulate– groundwork for correlation)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is Jon Stewart Mill known for in scientific method?

A
  1. Eliminating rival explanations 2. Testing multiple hypotheses 3. Control groups 4. Manipulating variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are Hume’s principles for inferring causality?

A
  1. Contiguity (events occur close together in space and time) 2. Temporal preference (A must come before B if it is cause of B) 3. Constant conjunction (A must always be present when B is present if A causes B
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is a better term for post-positivism?

A

Sophisticated Falsificationism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are principles of post-positivism?

A
  1. Test with multiple competing hypotheses 2. Theory is viable to the extent to which it has been systematically been subject to and survived multiple attempts to confirm and disconfirm it 3. Disconfirmation is more effective
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Two ways of defining a set.

A
  1. List - listing all members of a set. 2. Rule - giving a rule for determining whether objects belong to a set
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Two basic set operations

A
  1. Intersection – overlap of two or more sets (A AND B) 2. Union - Set that contains all members of one set and all members of another set (A OR B)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are the 7 steps of the General Linear Model (GLM)

A
  1. Specify the statistical hypotheses 2. Specify the statistical model 3. Estimate parameters of the model 4. Assess goodness of fit/effect size 5. Test hypotheses on the model parameters 6. Assess the adequacy of the model 7. Make a decision (to accept or reject the statistical hypotheses) based on this… accept or reject the research hypotheses
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are the four scales/levels of measurement?

A
  1. Nominal 2. Ordinal 3. Interval 4. Ratio
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

How do you graph nominal data?

A

Bar, pie, or histogram (histogram if variable is on a continuum)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How do you graph ordinal data?

A

Frequency distribution, bar, pie, or histogram

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

How do you graph interval data?

A

Line graphs, percentiles, histograms, frequency distributions, bar, pie, histogram

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

How do you graph ratio data?

A

Cartesian plots, anything you can do with lower levels of measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Central tendency

A

Mode, median, mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Spread

A

Range, inclusive range (high - low +1), variance, standard deviation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What measures of central tendency are appropriate for nominal data?

A

Mode only

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What measures of central tendency are appropriate for ordinal data?

A

Mode and median

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What measures of central tendency are appropriate for interval data?

A

Mode, median, and mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What measures of central tendency are appropriate for ratio data?

A

Mode, median, and mean (and some things we don’t use)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What measures of variability are appropriate for nominal data?

A

None

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What measures of variability are appropriate for ordinal data?

A

Range only

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What measures of variability are appropriate for interval data?

A

Range, variance, and SD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What measures of variability are appropriate for ratio data?

A

Range, SD, SD squared

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Properties of Z scores

A

Mean = 0 V = 1 SD = 1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

How are sums of squares inflated?

A

Dependent on sample size. Dependent on dispersion. Bigger sample size, bigger sums of squares

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Types of probability

A

A priori and a posteiori

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Why do we learn statistics?

A
  1. We live in an inductive world and all samples have error. 2. Statistics help us assign probability to effects being produced by chance alone.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

Properties of line of best fit

A
  1. Will always pass through the data point representing mean of x and mean of y. 2. Can draw line of best fit if have intercepts and means.
47
Q

Why is probability important?

A

It is the heart of science. What’s the probability of a result being accounted for by error?

48
Q

Why is it important to operationalize your population?

A

Do know how representive the sample is of the population.

49
Q

How do we operationalize population?

A

State who we are talking about with explicit inclusion and exclusion criterion. Make distinction between target population and sample population

50
Q

What makes a sample random?

A

Identifying population BEFORE sampling and then systematically, randomly, choosing participants

51
Q

What’s the difference between randomization and random selection?

A

Randomization refers to random assignment to conditions. Random selection refers to collecting the sample of a population. Can have randomization of a convenience sample. Ideally, have randomization of a random sample.

52
Q

What is the best estimate of population mean?

A

Mean of means

53
Q

Standard error of measurement

A

Always smaller than standard deviation. The smaller the better. Dependent on metric and SD.

54
Q

What’s the difference between frequency distribution and sampling distribution?

A

Frequency is from your sample. Sampling distribution comes from a large number of samples plotted to a graph (probability density functions – purely mathematical models)

55
Q

What is the number one rival hypothesis?

A

Error

56
Q

B always refers to

A

Population. This is what we’re interested in.

57
Q

Properties of statistical hypothesis

A
  1. Must be directly connected to research hypothesis. 2. Clear, logical connection 3. Statistical and research hypothesis must be consistent with one another.
58
Q

How do you calculate a shrunken effect size?

A

1 - (1 - r^2)(N-1 / N - K - 1)

59
Q

What happens to shrunken effect size when increasing sample size?

A
  1. Adjustment is lower 2. Error reduces at exponential rate
60
Q

What is a t-test (general)?

A

Sample - parameter / SE statistics

61
Q

What are degrees of freedom?

A

The amount of unknowns we can compute from knowing the mean and a set of known terms contributing to the mean

62
Q

What does a confidence interval tell us?

A

There is a certain chance (usually 95%) that this range contains population mean (it is not a guarantee that the range includes the population mean).

63
Q

What does a confidence interval containing 0 tell us?

A

Insignificant finding (we cannot exclude the possibility of chance).

64
Q

What is the relation between sample size and confidence intervals?

A

Smaller sample size means larger confidence intervals.

65
Q

What is Type 1 error?

A

Rejecting the null hypothesis when it is true in the population

66
Q

What is Type 2 error?

A

Failing to reject the null hypothesis when there is a true effect in the population

67
Q

Statistical power =

A

1- Beta

68
Q

What group does Type 1 error apply to?

A

Sample

69
Q

What group does Type 2 error apply to?

A

Population

70
Q

Statistical power is a function of what (4 things)?

A
  1. Alpha level 2. Beta level 3. Sample size 4. Effect size
71
Q

What is the relation between sample size and statistical power?

A

Positive – increase n, increase power

72
Q

What is the problem with counseling psych research regarding power?

A

Average statistical power is .2 = 20% chance of finding effect)

73
Q

What is the purpose of a power analysis?

A

To determine the amount of participants needed to achieve sufficient power in a study

74
Q

What is a priori power analysis?

A

Occurring before collecting data. Determine alpha level, estimate power for population based on smallest effect size expected – do computations to deduce sample size

75
Q

What are the two types of statistical power analysis?

A
  1. A priori 2. Post-hoc
76
Q

What is post-hoc power analysis?

A

Given results, effect size, n, and alpha, what power did the statistical test have to determine an effect?

77
Q

What is a large effect size in Counseling Psychology research?

A

.15

78
Q

What is a medium effect size in Counseling Psychology research?

A

.058

79
Q

What is a small effect size in Counseling Psychology research?

A

.01

80
Q

How do you calculate lower boundary of a confidence interval?

A

X - (1.96 x SE)

81
Q

How do you calculate upper boundary of a confidence interval?

A

X + (1.96 x SE)

82
Q

Validity is a property of…

A

The inferences that we make– not research design/method

83
Q

What do Cook and Campbell outline at the validity typology?

A
  1. Statistical conclusion validity 2. Internal validity 3. Construct validity 4. External validity
84
Q

What is statistical conclusion validity?

A

Validity of inferences about the correlation (covariation) between treatment and outcome

85
Q

What is internal validity?

A

The validity of inferences about whether observed covariation between A (the presumed treatment) and B (the presumed outcome) reflects a causal relationship from A to B as those variables were manipulated or measured.

86
Q

What is construct validity?

A

The validity of inferences about the higher order constructs that represent sampling particulars

87
Q

What is external validity?

A

The validity of inferences about whether the cause-effect relationship holds over variation in persons, settings, treatment variables, and measurement variables

88
Q

heteroscedasticity

A

variances between multiple groups are not equal

89
Q

Sphericity

A

Multivariate homogeneity of variance

90
Q

Why can’t we predict success/failure of individuals

A

Probability (and Type 1 and Type 2 error) applies to groups, not individuals

91
Q

What does it mean to fail to reject the null hypothesis?

A

Cannot conclude that there is no relation in the population because there are many potential reasons for this finding

92
Q

What is the nil hypothesis?

A

Since in psych nearly all variables are related in some way, nil hypothesis states that variables will be minimally related (instead of not related as per null hypothesis)

93
Q

Why should we not set up studies to affirm null hypothesis?

A

It is not possible to affirm null hypothesis – alternative explanations

94
Q

When is it okay to seek to affirm null hypothesis?

A

When testing statistical assumptions (homogeneity of variance, means, etc.)

95
Q

What are our priorities when seeking to affirm the null hypothesis?

A

Preserve Type II error rate at expense of Type 1 (we need to be able to find an effect if it exists)

96
Q

What is research design (as per KL)?

A

Plan, structure, and strategy of investigation to obtain answers to research questions. Testing relatinos and the theories they are based upon.

97
Q

All psychological studies are…

A

Correlational design in nature.

98
Q

What is the purpose of research design?

A

Control and rule out rival explanations through logic

99
Q

Can we label research design by statistical analysis?

A

No. Can use any statistical design in any research design. Design is broader than statistical procedure (they are distinct)

100
Q

What are the types of research design (per KL)?

A
  1. Ex-post facto 2. Quasi-experimental 3. Experimental
101
Q

By what 2 things are types of research design differentiated?

A
  1. Ability to manipulate 1 or more variables 2. Ability to randomly assign experimental conditions.
102
Q

With regard to variable manipulation and random assignment, ex-post facto…

A

Does not possess either

103
Q

With regard to variable manipulation and random assignment, quasi-experimental design

A

Can manipulate variables but not randomly assign

104
Q

With regard to variable manipulation and random assignment, experimental design

A

Can both manipulate variables and randomly assign participants

105
Q

What impact does random sampling have on determining level of research design (ex-post facto, quasi-experimental, experimental)

A

None. Random assignment is what matters for this distinction.

106
Q

What is the purpose of reasoned argument in research design?

A
  1. Sets context for study 2. Identifies phenomena of interest 3. Establishes theoretical importance 4. Clearly defines constructs and consistently uses terminology 6. Explicates theorizing 7. Culminates in falsifiable hypotheses
107
Q

What is Type 3 error (error of the third type)?

A

Mismatch between theory and research design

108
Q

When creating a reasoned arguments, ask yourself:

A
  1. What will this study add to the literature? 2. Why should a journal publish this?
109
Q

Why is it important to become more knowledgeable about statistical procedures and research design?

A

Become a better producer and consumer of research – help control confounds/error and gain sophistication in considering alternative explanations for results

110
Q

What are threats to validity?

A

Sources of error that can be affecting the inferences that we make (reasonable, not merely plausible)

111
Q

What are the most important things to check with regard to threats to validity in clinical work?

A
  1. Medical explanation 2. Fundamental attribution error – circumstances rather than disposition
112
Q

What are four threats to hypothesis validity?

A
  1. Inconsequential research hypotheses 2. Ambiguous research hypotheses 3. Noncongruence of research hypotheses and statistical hypotheses 4. Diffuse statistical hypotheses and tests
113
Q

Definition of reasoned argument

A

Coherent, internally consistent package that is both rigorous and well articulated (explicit) and systematically examines alternative explanations.