Observations and Surveys

Question 1

Survey

Answer 1

A method of posing questions to people on the phone, in-person interviews, written questionnaires, or via the internet.

Question 2

What are the 5 types of question formats?

Answer 2

1. open ended
2. forced choice
3. likert scale
4. likert-type scale
5. semantic differential format

Question 3

Open-Ended Questions

Answer 3

Allows respondents to answer any way they would like.

Question 4

What are pros of open ended questions?

Answer 4

Provide rich and spontaneous information.

Question 5

What are cons of open ended questions?

Answer 5

Responses must be coded and categorized (difficult and time consuming)

Question 6

Forced-Choice Questions

Answer 6

Respondents give their opinion by picking the best of two or more options.

Question 7

What are pros of forced choice questions?

Answer 7

Easy and efficient to code.

Question 8

What are cons of forced choice questions?

Answer 8

Limited answer choices that might not match up with what a respondent wants to select.

Question 9

Likert Scale Question

Answer 9

Uses a rating scale containing multiple response options anchored by specific terms (strongly agree, agree, neither, disagree, strongly disagree)

Question 10

What are pros of Likert Scale questions?

Answer 10

Simple to use, quantifiable (data can be analyzed statistically) and efficient

Question 11

What are cons of likert scale questions?

Answer 11

• Central tendency bias
• limited depth
• Assumption of equal intervals

Question 12

What are the two types of specific Likert Scales?

Answer 12

1. Likert-Type Scale
2. Semantic Differential Format

Question 13

Likert-Type Scale

Answer 13

A Likert scale system but uses different labels compared to the original Likert scale.

Question 14

Semantic Differential Format

Answer 14

Use of a response scale whose numbers are anchored with contrasting adjectives.

Example:
(Show up and pass) vs (Hardest thing I’ve ever done)

Question 15

What impacts the way peiple answer questions?

Answer 15

The way a question is worded and presented

Question 16

What needs to be true about every question?

Answer 16

Need to be clear and straightforward

Question 17

What are 3 types of biased question formats?

Answer 17

1. Leading questions
2. Double Barreled Questions
3. Negatively Worded Questions

Question 18

Leading Question

Answer 18

A type of question that is problematic because its wording encourages one response more than others.

Question 19

Double Barreled Question

Answer 19

A type of question that is problematic because it asks two questions in one.

Question 20

What is the main problem with double barreled question?

Answer 20

People may only respond to one or even both parts of the question but it is unknown

Question 21

Negatively Worded Questions

Answer 21

A question that contains negatively phrased statements, making its wording complicated or confusing.

Question 22

What are key words for negatively worded questions?

Answer 22

Impossible and Never

Question 23

What are the two types of bias responses?

Answer 23

1. Response Sets
2. Social Desirability

Question 24

Response Sets

Answer 24

A shortcut used when people are answering survey questions, selecting all positive, negative, or neutral answer choices.

Question 25

What are the two types of response sets?

Answer 25

1. Acquiescence 2. Fence Sitting

Question 26

Acquiescence

Answer 26

People say “yes” or “strongly agree” to every answer option.

Question 27

How do you avoid acquiescence?

Answer 27

Use reverse worded items

Question 28

Reverse Worded Items

Answer 28

The wording of questions is changed to mean the opposite as the one before.

Question 29

Fence Sitting

Answer 29

Playing it safe by answering the middle of the scale for all questions.

Question 30

How do you avoid fence sitting?

Answer 30

Remove the center (neutral) option in a likert scale

Question 31

What is a draw back of removing the neutral choice option?

Answer 31

People genuinely have a neutral response, and they are now forced to pick one that is incorrect to their beliefs.

Question 32

Social Desirability Responding

Answer 32

Giving answers on a survey that makes one look better than they are.

Question 33

How do you avoid social desirability responding?

Answer 33

- Ensure respondents know their responses are anonymous - Include questions that identify social desirability in outside examples

Question 34

What do all of the forms of question wording and response bias in a survey decrease?

Answer 34

The construct validity

Question 35

Why can self-reporting be inaccurate?

Answer 35

Participants sometimes giving unintentionally wrong information. - Convince themself for an answer with no reasoning - Forget details

Question 36

Observational Research

Answer 36

The process of watching people or animals and systematically recording how they behave or what they are doing.

Question 37

What can observational research be?

Answer 37

The basis for frequency claims

Question 38

What can observational research operationalize?

Answer 38

Variables in association and causal claims

Question 39

What does observational research need to have?

Answer 39

Good construct validity

Question 40

What is something observational research is better at than self-reporting?

Answer 40

Telling accurate stories

Question 41

What are the 2 forms of observer bias?

Answer 41

1. Observer Bias 2. Observer Effects

Question 42

Observer Bias

Answer 42

A bias that occurs when observer expectations influence the interpretation of participant behaviors and the outcome of the study. - based on own opinions rather than facts

Question 43

Observer Effects (expectancy effect)

Answer 43

A change in behavior of study participants in the direction of observer expectations.

Question 44

What are two ways to prevent observer bias?

Answer 44

1. Inter-rater reliability 2. Masked research design

Question 45

Inter-rater Reliability

Answer 45

- Observers are trained and use codes to precisely state how the variables are found. - Using multiple raters allows for comparison between answers.

Question 46

Masked Research design

Answer 46

A study design where the observers are unaware of the experimental conditions to which participants have been assigned.

Question 47

Reactivity

Answer 47

A change in the behavior of study participants because they are aware that they are being watched.

Question 48

What are the 3 ways to avoid reactivity?

Answer 48

1. Blend in - Unobtrusive observations 2. Wait it out - Don't begin observing until participants are comfortable with the observer being around 3, Measure Behavior's Results - Observe what participants leave behind rather than their present behavior

Question 49

Unobtrusive Observations

Answer 49

An observation in a study made indirectly, through physical traces of behavior, or by someone who is a hidden bystander.

Question 50

What is an example of measuring what participants leave behind?

Answer 50

Examining wear and tear on specific flooring areas of a museum