Midterm 1 Flashcards

1
Q

What is a hypothesis?

A

An assertion of one possible state of the phenomenon or relationship under investigation. In other words, a proposed explanation for a question you are asking.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

When is a hypothesis falsifiable?

A

A scientific hypothesis is falsifiable when it it is specific. A genuine test of a hypothesis is one that tries to refute it, not confirm it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

When is a hypothesis useless?

A

A hypothesis is essentially useless if it is consistent with every possible outcome. Rather, a hypothesis should be consistent with only a subset of possible empirical (observable) outcomes, and incompatible with others.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why are testable hypotheses necessary?

A

This is because science is ever-changing, and refining. The scientific status of a theory is based on its falsifiability, refutability, or testability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the purpose of a hypothesis?

A

It helps us generate simple models of the physical world, that allow us to predict phenomena, determine causes of phenomena, explain phenomena and control phenomena.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

When is a hypothesis unfalsifiable?

A
  1. When no empirical evidence is obtainable
  2. When predictions are so vague that they can hardly fail
  3. When a hypothesis is upheld even though refuted by data, by introducing additional assumptions after the fact.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an operational definition?

A

A testable hypothesis must be operationally defined. An operational definition is a description of how a concept will be measured. Essentially, turning a concept into a quantity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an example of an operational definition?

A

Happiness can be measured by how many times someone smiles in an hour, brain activity, or a self-report survey.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the purpose of an operational definition?

A
  1. They allow us to quantify and measure concepts.
  2. It makes sure variables are measured throughout the study.
  3. It allows us to communicate ideas to others.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What makes a good operational definition? VAAPORC

A

V - Validity (did your operational definition measure what
it actually intended to measure)?
A - Absence of bias
A - Acceptance in the scientific community
P - Practicality (something easy to measure)
O - Objective
R - Reliability
C - Cost (it is cost-effective)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Reliability and bias refer to____?

A

Refers to the difference between the measure and the “true” value of that variable. This difference is referred as systematic error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is bias?

A

Bias is the average error over many measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the differences between hypotheses and predictions?

A

Hypothesis is framed as a statement, whereas a prediction is more related to the specific methodological details.
Hypothesis is often phrased in present tense, whereas predictions are often in the future tense.
Hypothesis is derived from a broader theory, whereas a prediction is quite specific.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the two main ways to assess operational definitions?

A

Reliability and validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Details about reliability

A
  1. Operational definition has to be based on concrete, observable behaviours.
  2. It must facilitate consistency/precision across measurements.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

The more the variation, random error, and noise decrease ______.

A

Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Details about validity

A
  1. Must be based on relevant behaviour

2. Facilitates the accuracy of measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

The more the systematic error, and bias decrease _____.

A

Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

A measurement is…….?

A

the true score + measurement error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Measurement error is…..?

A

systematic error + random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What factors contribute to measurement error?

A
  1. Precision of the operational definition (lack of detail, subjectivity, and specificity)
  2. Error as a result of the measurement device.
  3. Human error (level of training, expertise, and attention level)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

The more specific the operational definition, the more ______.

A

Consistent the measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What does the r value represent?

A

It represents the correlation between the two variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the r values?

A

r>0, positive correlation
r<0, negative correlation
r = 0, no correlation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What are the types of reliability measures?

A

Inter-rater reliability (finding consistency between raters)
Test-retest (re-taking the same test over and over)
Internal consistency reliability includes split-half reliability, Cronbach Alpha, and item-total.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

How come test re-test is sometimes difficult?

A

It can become biased. If someone is taking the same test, over and over, they may become better at it over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is construct validity?

A

How well a test or tool (hypothesis, operational definition etc.) measures what it intended to actually measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are the indicators of construct validity?

A
  1. Face validity
  2. Content Validity
  3. Predictive Validity
  4. Concurrent Validity
  5. Convergent Validity
  6. Discriminant Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is face validity?

A

Does the test appear to measure what it is intending to measure. As face validity is a subjective measure, it’s often considered the weakest form of validity. However, it can be useful in the initial stages of developing a method.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is content validity?

A

Content validity assesses whether a test is representative of all aspects of the construct. To produce valid results, the content of a test, survey or measurement method must cover all relevant parts of the subject it aims to measure. If some aspects are missing from the measurement (or if irrelevant aspects are included), the validity is threatened.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is an example of content validity?

A

A mathematics teacher develops an end-of-semester algebra test for her class. The test should cover every form of algebra that was taught in the class. If some types of algebra are left out, then the results may not be an accurate indication of students’ understanding of the subject. Similarly, if she includes questions that are not related to algebra, the results are no longer a valid measure of algebra knowledge.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is predictive validity?

A

This is the degree to which a test accurately predicts a criterion that will occur in the future. For example, a prediction may be made on the basis of a new intelligence test, that high scorers at age 12 will be more likely to obtain university degrees several years later. If the prediction is born out then the test has predictive validity. “Can our measure predict something in the future?” Can this selection test predict performance on the job?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What is concurrent validity?

A

This is the degree to which a test corresponds to an external criterion that is known at the time and is already valid. If the new test is validated by a comparison with a currently existing criterion, we have concurrent validity.

These are both for the same construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What is an example of concurrent validity?

A

For example, let’s say a group of nursing students take two final exams to assess their knowledge. One exam is a practical test and the second exam is a paper test. If the students who score well on the practical test also score well on the paper test, then concurrent validity has occurred.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What is convergent validity?

A

Convergent validity is a supporting piece of evidence for construct validity. The underlying idea of convergence validity is that related construct’s tests should be highly correlated. For example, in order to test the convergent validity of a measure of self-esteem, a researcher may want to show that measures of similar constructs, such as self-worth, confidence, social skills, and self-appraisal are also related to self-esteem.

  • different methods of measuring the same construct, to see whether both are related
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is discriminant validity?

A

Discriminant validity tests whether concepts or measurements that are not supposed to be related are actually unrelated.

  • the same methods, measure different constructs, give scores that are NOT correlated.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Concurrent and predictive validity are the _______, whereas convergent and discriminant is based on ______.

A
  1. gold standard

2. other measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What is a variable?

A

an event, situation, behaviour, or characteristic. Something that has a quality or quantity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What is a quantitative variable?

A

A variable that measures a magnitude or quantity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What are the types of quantitative variables?

A
  1. Interval - all quantitative variables are interval, but 0:00 is not defined. Celsius or Fahrenheit is not a ratio variable because 0°C does not mean there is no temperature
  2. Ratio - takes into account a true zero. Such as time at 0:00, that is a meaningful time. Weight, age, pulse rate, etc.
  3. Discrete variable - Variables that can only take on a finite number of values are called “discrete variables.” For example, you can only use whole numbers when describing your siblings. You can’t have HALF a sibling.
  4. Continuous variable - Variables that can take on an infinite number of possible values are called “continuous variables.” For example, height can be continuous as in 1.65 metres.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What is a categorical variable?

A

Variables that have different qualities (gender, colours, where you live etc).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What are the types of categorical variables?

A

Nominal - there is no obvious relationship between the levels
Ordinal - takes on an order (i.e., pain level on a scale of 1-5).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

How can we distinguish between these variables?

A

You can usually take an average or use a subtraction test for a quantitative variable.
Quantitative variables can be discrete or continuous. If we use a midway test, by taking two values and averaging them, if that new value has a meaning it is discrete. If not, it is continuous.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

What is monotonic vs. non-monotonic?

A

Non-monotonic means that the relationship does not always go in a single direction (i.e., non-linear).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

What are the key points of non-experimental research?

A
  1. No direct intervention
  2. Observational or correlational
  3. Both variables are measured
  4. You can record record physiological responses, or observe behaviour.
  5. Examples include self-reports, or using existing records.
  6. Cannot determine causal relationships
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

What are the key points of experimental research?

A
  1. At least one variable is manipulated, the IV.
  2. One variable is measured, the DV.
  3. Can determine causal relationships
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

What is a spurious correlation?

A

Two variables that appear causal, when they are actually not.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

What is a confounding variable?

A

Variables that influence both the dependent and independent variable. The confound makes it hard to determine which variables are actually causing the effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

What is the difference between a confounding variable and extraneous?

A

Extraneous variables, which are any factors that are in the experiment but not being studied, and confounding variables, which are related to the independent variable and affect the dependent variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

What are potential confoudns?

A

Poor operational definitions, participant factors (age, intelligence, socio-economic status), order effects (fatigue, practice), and group factors

51
Q

How do we eliminate extraneous variables and even confounds?

A

Random assignment. Random assignment normalizes the effects of confounds.

52
Q

What is internal validity?

A

The extent to which a study establishes a cause-and-effect relationship between a treatment and an outcome.

53
Q

What is random assignment?

A

With random assignment, each participant has an equal chance of being placed in any of the experimental groups or control groups.

54
Q

What is the difference between random sampling and random assignment?

A

Random sampling is different from random assignment. Random sampling involves recruiting random subjects from the population to ensure there is no bias etc.

55
Q

What are descriptive statistics?

A

They help us organize, summarize and describe data (usually based on samples)

56
Q

What are inferential statistics?

A

They help us make generalizations from the sample to the population.

57
Q

What information can you get from descriptive statistics?

A

Shape, spread (variability), outliers, and central tendency.

58
Q

What kind of graphical representations can you use?

A

A pie chart, bar graph, histogram, or frequency table.

59
Q

Categorical variables use _______, whereas quantitive variables use __________.

A
  1. Bar graph and pie chart

2. Histogram

60
Q

The smaller the sample, the greater the _______.

A
  1. Deviation
61
Q

What does the law of large numbers tell us?

A

As sample size increases, the statistics become less variable, and more closely estimate the true population.

62
Q

What characteristics are given by frequency distributions?

A

Shape, central tendency, and variability.

63
Q

What shapes do distributions take on?

A

Symmetric (each half is a mirror image of the other)

Skewed (positively skewed - tail is on the right, negatively skewed - the tail is on the left).

64
Q

Details about modality

A

There can be unimodal, bimodal, multimodal, or uniform (no defined mode) distributions.

65
Q

What does the central tendency tell us?

A

The mean, the median (50th percentile), and the mode (most frequently occurring data).

66
Q

What central tendencies can be used for quantitative variables (both ratio and interval)?

A

Mean, median and mode.

67
Q

What central tendencies can be used for categorical variables (nominal, and ordinal)

A

Nominal - mode

Ordinal - median, and mode

68
Q

What are the pros and cons of the mode?

A

Pros - it can be used for all types of data

Cons - it only tells you the most frequently occurring data point, but ignores the rest of the data

69
Q

What are the pros and cons of the median?

A

Pros - Robust against outliers, it gives us a better summary of skewed data, and can be used with ordinal data
Cons - Limits the use of many statistical tests

70
Q

What are the pros and cons of the mean?

A

Pros - tells us the average
Cons - cannot be used for categorical data, sensitive to outliers, and a poor measure of “central tendency” for highly skewed distributions

71
Q

What is survey research?

A

A survey/self-report that is administered through an interview or questionnaire.

72
Q

What is the purpose of survey research?

A

To learn about attitudes and beliefs, facts, demographics, and behaviours.

73
Q

Who created the first survey?

A

Charles Darwin

74
Q

What do surveys usually include?

A
  1. open ended or closed ended questions
  2. a methodology for asking people to tell them about themselves
  3. can be used to study relationships between variables
  4. can serve as an important complement to experimental research findings
75
Q

What are some issues with question wording in surveys?

A
  1. unnecessary complexity - using unfamiliar technical terminology, or phrasing that overloads your working memory
  2. vague questions - using imprecise terms, or poor grammatical structure
  3. loaded/leading questions - embedding questions with misleading information, written in a way to bias the information
  4. double-barrelled questions - asking two things at once
  5. negative wording - the question should not have double negatives
  6. yay-say or nay-say wording - hard to distinguish responses from a participant, especially if they are not actually doing the survey properly. To fix this, put a specific question saying “for this question, please put highly disagree.”
76
Q

What is an example of a leading question?

A

How great is our hard-working customer service team?

77
Q

What is an example of a double-barrelled question?

A

Was the product easy to find and did you buy it?

78
Q

What is an example of a negative question?

A

Was the facility not unclean?

79
Q

What are some options for responses to questions?

A
  1. Likert scales
  2. Use an odd number of levels
  3. Rating scales
  4. Non-verbal scales (i.e., use of a facial expression)
80
Q

What are response sets?

A

This is the human tendency to answer questions in ways that are the most complimentary, or flattering, to the respondent rather than telling the absolute truth. This includes demand characteristics, and social desirability bias.

81
Q

How can we avoid demand characteristics and participant bias?

A
  1. Anonymity
  2. Deception
  3. Disguise the dependent measure by putting random questions so the participant cannot guess the true purpose of the story
  4. Ask the participant what they thought the hypothesis was during the debriefing stage
82
Q

What things should we consider when finalizing the survey?

A
  1. Attractive and professional layout
  2. Neatly typed, and free from errors
  3. Consistent point scales
  4. Ask interesting questions first
  5. Keep the survey short as possible
83
Q

How are surveys distributed?

A
  1. in person to groups or individuals
  2. Mail
  3. Internet surveys
  4. Apps
84
Q

What are the advantages and disadvantages of surveys?

A

Pros - less costly than interviews, and can ensure anonymity

Cons - Boredom and distraction. Participants may also not answer correctly.

85
Q

Population vs. sample

A

Population - all individuals of interest

sample - a sample of some of these individuals

86
Q

What is a census?

A

If we study everyone in the population, it is referred to as a census.

87
Q

What is a confidence interval?

A

A range of values that’s likely to include a population value with a certain degree of confidence.

88
Q

Smaller sample sizes have _____________.

A
  1. Greater confidence intervals, and larger variability.
89
Q

What are the differences between non-probability sampling, and probability sampling?

A

In non-probability sampling, you do not need to use random sampling, but rather you can use convenience sampling. This is because the phenomena under investigation is expected to be relatively similar across the population. Ex: limit of short term memory.
In probability sampling, the phenomena under investigation is expected to vary across the population. Ex: beliefs, values, political view etc. In this case, we need a technique that would be representative of an entire population.

90
Q

What are the types of probability sampling?

A
  1. Simple random sampling - every member of a population has an equal probability of being selected
  2. Stratified random sampling - population is divided into subgroups, and random samples are taken from each strata. Ex: All students are grouped by their major, and then 50 students are randomly chosen from each major.
  3. Cluster sampling - randomly selects clusters and uses all individuals belonging to those clusters. Ex: psych majors are identified at 100 schools. Then 10 of those clusters are chosen. All students in each cluster are sampled.
  4. Multistage cluster sampling - clusters are identified, and then only some individuals from each cluster is chosen
  5. Systematic sampling - choosing every nth person from a group
91
Q

What are the types of non-probability sampling?

A
  1. Convenience sampling - sampling whoever is most convenient
  2. Purposive sampling - a sample of individuals that meet a pre-determined criterion (ex: age, gender etc.)
  3. Quota sampling - sampling reflects the numerical composition of various groups
92
Q

Do sample sizes need to increase proportionally with the population to keep precision?

A

No, this is not necessary.

93
Q

What does the p-value indicate?

A

p>0.05 indicates that the results are not statistically significant, and that random assignment has failed.

94
Q

What is a two sample t-test used for?

A

It is used to test the difference between the population of two means.

95
Q

When is a paired t-test used?

A

We use this when we are interested in two variables by the same subject (ex: measuring the left hand and right hand)

96
Q

When do we use a one-way ANOVA?

A

Used to determine the difference between one factor, with at least two levels that are independent of each other.

97
Q

When do we use a chi test?

A

We use this to find the significance between two or more categorical variables.

98
Q

How do we determine which test to use?

REFER TO THE SLIDE

A
  1. scale of measurement (nominal vs. ordinal, or ratio vs. interval)
  2. how many levels of the IV are there?
  3. Repeated measures vs. independent groups
  4. are we looking for parametric or non-parametric tests?
99
Q

What are the main types of experimental design?

A

Independent groups, and repeated measures

100
Q

What is an independent group study?

A

Different participants experience different levels of the IV.

101
Q

What is a repeated measures study?

A

The same participants experience all the different levels of the IV.

102
Q

When is it not possible to do a repeated measure experiment?

A

sometimes in animal studies we have transgenic mice vs. wild type or in humans we want to see the difference between male and female. In addition, sometimes one treatment requires surgery, while the other does not.

103
Q

What are the advantages of repeated measure?

A
  1. fewer participants needed
  2. greater power
  3. more likely to detect true differences
  4. reduces confounds because it accounts for individual differences, since it it all the same participants
104
Q

What are the disadvantages of repeated measure?

A

Order effects: fatigue, practice, contrast effect (dog photo example)
Demand characteristics

105
Q

How do we counteract order effects?

A

Counterbalance - do treatment A and then B, and then switch to B and then A.

106
Q

Why is counterbalancing often difficult?

A

If you have 4 conditions, you have to have 24 variations. As a result, you would need a minimum of 24 people just to have 1 person in each condition.

107
Q

How can counterbalancing be solved?

A
  1. We can use partial counterbalancing. This is the use of the latin square. Each condition appears in each position once.
  2. Randomize the treatment conditions
  3. Reverse counterbalancing ABC -> CBA
  4. Have a time interval between conditions
  5. Use independent group design
108
Q

What are the advantages of independent groups?

A
  1. avoids order effects
  2. avoids demand characteristics
  3. treatments with relatively permanent effects
  4. similar to real world setting
109
Q

What are the disadvantages of independent groups?

A
  1. greater risk for confounds due to individual differences

2. any true differences may not be detected due to lower power

110
Q

How do we prevent this from happening?

A
  1. random assignment
  2. matched pairs
  3. using spouses because the other individual is likely similar age, and living in the same environment
111
Q

How do we avoid placebo effect?

A
  1. use of a placebo group to avoid confusion

2. waitlist control group

112
Q

What is the reactive adaptive participant bias?

A

Ask tasks get more difficult, if participants are uncertain about their answer in a task, they will give an answer they are not sure of. Sometimes they will answer incorrectly on purpose, so the questions stay at the same difficulty level.

113
Q

How do we avoid this type of bias?

A

Do not always increase difficulty after every correct answer.

114
Q

What is experimenter bias?

A

Experimenters who know the treatments may treat participants in different conditions differently or interpret data differently.

115
Q

How do we avoid experimenter bias?

A
  1. Repeated measures design
  2. Single-blind or double blind
  3. Automated presentation of conditions and recording of data (i.e., use of a computer program)
116
Q

What are complex experimental deisngs?

A

IVS with more than two levels, or designs with more than one IV.

117
Q

Why do we use multiple levels of IV?

A
  1. Detect non-linear relationships between the IV and DV. For a curved and non-linear relationship we need at least 3 levels.
    Rule out alternative explanations and eliminate confounds. Refer to music example
118
Q

What is a 2 x 2 factorial design?

A

This experiment has 2 IV and 2 levels.

119
Q

What is a marginal mean?

A

A marginal mean, shows the average of the main effects of the independent variable.

120
Q

How do we determine main effects and interactions from factorial designs?

A

Main effect in A or B, have a difference in the averages
Interactions have a difference between the cells.
Main effects on graph you see parallel lines
Interactions - non parallel lines (crossing lines, converging, diverging)

121
Q

Explain this 2x3x4 design

A
How many IVS? - 3 
How many DVS? - 1 
How many levels? - 2 + 3 + 4 = 9 
How many main effects? - there can be three, one per IV
How many interactions? AB,AC,BC,ABC
122
Q

What are the differences between measurement error, systematic error, and random error?

A

Measurement error:
systematic error + random error
The extent that a measure is unreliable

Systematic error:
Created by faulty equipment or bias (the error is always the same amount each trial)
Decreases validity

Random error:
Errors are unpredictable and cannot be reproduced.
Decreases reliability

123
Q

Describe variability and reliability in terms of an operational definition

A

Variability:
Does the operational definition measure the concept it’s supposed to?

Reliability:
Is the operational definition based on observable, objective behaviors?