Chapter 5 Flashcards

1
Q

Measurement

A

is the assignment of numbers to indicate different values of a variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Measures

A

are specific techniques or instruments used for measurement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Evaluation

A

is the procedures for collecting information and using information to make decisions. Evaluation involves measurement, but may also involve sampling, design, and literature in the process of coming to a decision.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

The purpose of measurement is _________________________________.

A

to obtain information about the variables that are being studied. It provides a systematic procedure for recording observations, performance, or other responses of subjects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Operational Definitions

A

Definitions of variables that specify how they were measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Assessment

A
  1. assess is to measure

2. an assessment is synonymous with an evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Nominal (Classificatory) Scale

A

A set of mutually exclusive categories with no order implied.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Ordinal Scale

A

A set of rank-ordered categories.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Interval Scale

A

Equal intervals between numbers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Ratio Scale

A

Numbers expressed as ratios

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the following an example of?

The operators equal and not equal are allowed.

A

example of nominal scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the following an example of?

The operators greater than, less than, equal, and not equal (and all their combinations) are allowed.

A

example of ordinal scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the following an example of?

Fahrenheit and Celsius

A

example of interval scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the following an example of?

Length and Kelvin temperature

A

example of ratio scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Statistics

A

Mathematical procedures used to summarize and analyze data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Descriptive Statistics

A

Indices that summarize characteristics of sample data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Statistics

A

describe sample data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Parameters

A

describe population data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Frequency Distribution

A

Data organized into scores and the frequency with which each score occurred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Frequency Polygon

A

A line graph with frequency along the y-axis and score along the x-axis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Histogram

A

A bar graph with the same characteristics as a frequency polygon

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Normal Distribution

A

A frequency distribution with a characteristic bell shape. It is symmetrical.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Skewed Distribution

A

A non-symmetric distribution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

positively skewed

A

Occurs when most of the scores are at the low end of the distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
negatively skewed
Occurs when most of the scores are at the high end of the distribution
26
Outliers
Atypical scores that are either extremely high or low
27
Histogram
Histograms use bars to represent frequency. The bars touch, and histograms are used for interval and ratio independent variables.
28
Measures of Central Tendency
Statistics that indicate the average or typical score in a distribution.
29
Mode
The most frequently occurring score or scores.
30
Median
The score (or potential score) at the 50 percentile. It splits the distribution with respect to frequency.
31
Mean
The sum of the scores divided by their number.
32
Measures of Variability
These measures tell us how spread out a distribution is.
33
Range
The largest score minus the smallest score.
34
Standard Deviation
The square root of the sum of squared deviations of scores from the mean, divided by their number. Also, the root mean squared deviation.
35
Variance
The standard deviation squared
36
Percentile Rank
The percentage of scores falling at or below a given score.
37
Correlation
A measure of the relationship between two variables
38
Scatterplot
A two dimensional graphic representation of the relationship between two variables. The variable represent each dimension, and each point represents an individual’s score on the X and Y variable.
39
Pearson Product Moment Correlation
The most common correlation coefficient, it detects linear relationships between variables.
40
validity
The overall evaluation of the extent to which theory and empirical evidence support interpretations that are implied in given uses of the scores Older Definition: the degree to which an instrument measures what it says it measures or purports to measure
41
bar charts
Bar charts also use bars to represent frequency, but the bars do not touch. Bar charts are used for nominal and ordinal independent variables
42
Evidence Based on Test Content
The specified domain should be sampled completely, but the test should not sample outside the specified domain. Determined by expert judges.
43
Evidence Based on Internal Structure
Items’ relations to each other, subtest scores, and total test scores should reflect the relations posited by theory and intended uses. Determined by statistical analysis.
44
Evidence Based on Relations to Other Variables
Relationships with other variables reflect relationships predict by theory and intended uses
45
Construct Validity
The extent to which relationship predicted by the psychological theory of the construct are reflected in relationship between the measure and other measures
46
Convergent Validity
The measure is significantly correlated with other measures that it theoretically should be correlated with (e.g., another measure of the same construct)
47
Divergent Validity
The measure is not significantly correlated with other measures that it theoretically should not be correlated with (e.g., IQ and big toe size)
48
Criterion Validity
The measure is correlated with another measure (the criterion).
49
Concurrent Validity
The two measures are collected at the same point in time.
50
Predictive Validity
The criterion measure is collected at a later point in time than the predictor measure.
51
Sources of Validity Evidence | Evidence Based on Response Processes
Data are collected from participants, often using think-aloud protocols, to determine participants’ mental processes during answering items on the test
52
Sources of Validity Evidence | Evidence Based on Consequences of Testing
Data is provided showing that the measure results in consequences for the test-taker that can be supported based upon empirical evidence
53
___________ can be performed to help establish validity of measures to be used.
Pilot studies
54
Reliability
is the extent to which participant and/or rater scores are free from error.
55
Reliability coefficients (and validity coefficient, for that matter), vary between ______ and ______
0.00 and 1.00
56
Equivalence (a form of reliability)
Two alternate forms of the same test (constructed by randomly choosing items from the same universe of items) are administered to the same group of individuals at approximately the same time.
57
Equivalence and Stability
Two alternative forms of the same test are administered to the same group of individuals at two different times.
58
Internal Consistency
A measure of the consistency of items on a test in measuring a single construct.
59
Split Half
Most commonly the test is split into odd and even items. These subtest scores are correlated and corrected using the Spearman-Brown Prophecy formula
60
Kuder-Richardson
Used with right vs. wrong items. Two formulas exist, KR-20 and KR-21. It is equivalent to the average of all possible split half reliabilities. KR-21 assumes equal item difficulty, while KR-20 does not assume equal item difficult
61
Cronbach’s Alpha
Also equal to the average of all possible split half reliabilities, but does not require dichotomous scoring (e.g., can be used with Likert scale items)
62
Percent Agreement
Percentage of cases on which the two observers or measures agree.
63
Cohen’s Kappa
Percentage agreement corrected for what would be expected by chance
64
A measure cannot be valid if it is not _______.
reliable
65
Test Length
Longer measures are more reliable than shorter measures, all other things being equal
66
Participant Heterogeneity
More heterogeneous scores will have higher reliability (this is sometimes referred to as the problem of restriction of range)
67
The Nature of the Domain
Some things are more difficult to measure reliably than others (e.g., academic achievement measures usually have higher reliability than personality measures)
68
Standardization of Data Collection
The more standardized the data collection methods, the higher the reliability will be