Week 5

Question 1

The process of quantifying a set of observations of a phenomenon

Answer 1

Measurement

Question 2

The working definition a researcher uses for a concept

Answer 2

Conceptual definition

Question 3

The process of defining the exact way you plan to measure the concept

Answer 3

Operationalization

Question 4

Any factor, trait, quality, or condition that can be measured

Answer 4

Variable

Question 5

Those defined by their attributes or characteristics. These attributes or characteristics are categorized into two categories: exhaustive and mutually exclusive

Answer 5

Nominal level of measurement

Question 6

The process of assigning a variable measured at the nominal level a numeric value

Answer 6

Coding

Question 7

Those defined by their attributes or characteristics that are categorized into two: exhaustive and mutually exclusive; however, the numeric value assigned to them by the researcher can be logically ranked, but the intervals between categories may not be equal

Answer 7

Ordinal level of measurement

Question 8

Also have to meet the criteria of being exhaustive and mutually exclusive. The numeric value assigned to the categories by the researcher can be logically ranked, which is similar to variables, measured on the ordinal level of measurement. Variables measured on this level, unlike variables measured on the ordinal level, have intervals between the categories that are equal.

Answer 8

Interval level of measurement

Question 9

Have all the characteristics of variables measured at the interval level, in addition to a true zero value. In other words, the zero does mean the absence of a construct or whatever is being measured; zero value has real meaning.

Answer 9

Ratio level of measurement

Question 10

Occurs when the data collected do not accurately reflects the construct we are attempting to measure.

Answer 10

Measurement error

Question 11

Occurs when there is a pattern to the error

Answer 11

Systematic error

Question 12

Providing the same response to all or most of the items on a measure

Answer 12

Response set

Question 13

The tendency of a person to respond in a positive manner to a question regardless of the question being asked

Answer 13

Acquiescent response set

Question 14

Occurs when the participants respond in a way that conveys a favorable impression of themselves or in a manner they believe will be more consistent with the researchers views

Answer 14

Social desirability bias

Question 15

Occurs when one group of study participants is more likely to recall the information requested than other groups of participants

Answer 15

Recall bias

Question 16

Occurs when study participants improve or change their behavior simply because they know they’re being studied

Answer 16

Hawthorne effect

Question 17

Occurs when there is no consistent pattern of measurement error

Answer 17

Random error

Question 18

A diminished ability to reject the null hypothesis

Answer 18

Bias towards the null

Question 19

The degree to which a measure is consistent or dependable

Answer 19

Reliability

Question 20

Defined as the degree of agreement between the raters

Answer 20

Inter-rater reliability

Question 21

The degree of agreement between the observers

Answer 21

Inter-observer reliability

Question 22

A statistic that is used to quantify the degree to which two raters or observers are in agreement

Answer 22

Cohen’s Kappa

Question 23

Ranges from zero, which indicates no agreement between the raters, to one, which indicates perfect agreement between the raters

Answer 23

Fleiss’ kappa

Question 24

Assesses the stability or consistency of a measure over time

Answer 24

Test-retest reliability

Question 25

A coefficient that can be used to assess the test-retest reliability of two administrations of a measure

Answer 25

Pearson product-moment correlation

Question 26

Used to assess the test-retest reliability, and those situations involving more than two administrations of a measure

Answer 26

Intraclass correlation coefficient

Question 27

Used to determine the consistency of items on a scale

Answer 27

Split-half reliability

Question 28

Achieved when the items on a scale are consistent with each other

Answer 28

Internal consistency

Question 29

Used to assess the degree of internal consistency of the scales items

Answer 29

Cronbach’s alpha

Question 30

The degree to which the measure actually measures what it was designed to measure

Answer 30

Validity

Question 31

Based simply on whether the measure appears to be valid “on its face”

Answer 31

Face validity

Question 32

Assessed by asking experts on the topic to evaluate whether the items on the measure cover the full range of the concept

Answer 32

Content validity

Question 33

Based on how the measure compares to a criterion

Answer 33

Criterion validity

Question 34

Indicates how well the measure corresponds with the criterion that is measured at the same time

Answer 34

Concurrent validity

Question 35

A type of concurrent validity that assesses whether a measure can differentiate between groups known to differ on the variable being measured

Answer 35

Known groups validity

Question 36

Assesses the ability of the measure to predict a criterion that occurs in the future

Answer 36

Predictive validity

Question 37

An assessment of how well the concept of the variable was translated into a measure

Answer 37

Construct validity

Question 38

A measure has__________ when it is correlated with measures that it should be related to, based on theory or empirical evidence

Answer 38

Convergent validity

Question 39

A measure has__________ when it is not correlated with other measures to which it should not be related to

Answer 39

Divergent validity

Question 40

Measures that have established reliability, and validity

Answer 40

Standardized measures

Question 41

Established scores that are used to determine if someone meets or does not meet a specific criterion

Answer 41

Cut-off scores

Question 42

The literal translation of the words

Answer 42

Denotative meaning

Question 43

Captures the weight or intensity of the words

Answer 43

Connotative meaning

Question 44

One person translates from the original language to the second language

Answer 44

One-way translation

Question 45

One person translates from the original language into the second language, and another person, then translates back into the original language

Answer 45

Back translation

Question 46

A process in which the original items are translated. After comparing the original and translated items, the original items may be revised, and then another translation is produced. This process continues until equivalent items are obtained in both languages.

Answer 46

Decentering

Question 47

A measure where the respondents complete the question

Answer 47

Self administered measure/questionnaire

Question 48

A measure where an interviewer reads the questions to the respondents

Answer 48

Interview schedule

Question 49

Questions in which the respondents are asked to provide their own answers to

Answer 49

Open-ended questions

Question 50

Questions in which the respondent is asked to select an option provided by the researcher

Answer 50

Closed-ended questions

Question 51

Usually contain the word no or not, and can reduce the reliability of the measure

Answer 51

Negatively worded items

Question 52

Usually contains more than one issue or topic yet allows for only one response

Answer 52

Double-barreled questions

Question 53

Questions that contain an assumption

Answer 53

Loaded questions

Question 54

Questions that encourage the respondents to respond in a particular way

Answer 54

Biased questions

Question 55

The presentation of items on a survey, where the respondents are asked to write the responses using a specified scale

Answer 55

Likert scale format

Question 56

Items on a scaled survey

Answer 56

Likert items

Question 57

The sum of responses of the Likert items

Answer 57

Likert scale

Question 58

Focuses on establishing equivalence by examining how items function across groups

Answer 58

Measurement equivalence

Question 59

The extent to which a measure is compatible with the language and culture to which it will be adapted

Answer 59

Linguistic equivalence

Question 60

The extent to which the concepts represented by the items making up the measure are understood to have the same meaning across cultural groups

Answer 60

Conceptual equivalence

Question 61

Equivalence in item or question difficulty across groups

Answer 61

Metric equivalence