Psychological Testing & Assessment

Question 1

What are the 7 assumptions about psychological testing and assessment?

Answer 1

Psychological Trait & States Exist.
These can be quantified and measured.
Test behavior predicts non-test behavior.
Tests have strengths and weaknesses
Sources of error are part of the process.
Testing & assessment can be done in a fair and unbiased way.
Testing & assessment benefit society.

Question 2

Any distinguishable, relatively enduring way in which individual varies from one another.

Answer 2

Trait

Question 3

Distinguishes one person from another but relatively less enduring.

Answer 3

State

Question 4

The key to insight.

Answer 4

Item content

Question 5

Long standing assumption that factors other than what a test attempts to measure will influence performance on the test.

Answer 5

Error

Question 6

Refers to the component of test score attributable to sources other than the trait or ability measured.

Answer 6

Error variance

Question 7

The stability or consistency of measurement.

Answer 7

Reliability

Question 8

Elements of error

Answer 8

Observer’s error
Environmental changes
Participant’s changes

Question 9

Reliability coefficient should not go beyond _.

Answer 9

+/- 1

Question 10

The __ the coefficient alpha, the higher the reliability.

Answer 10

Higher

Question 11

Test scores gain reliability as the number of _ increases.

Answer 11

Items

Question 12

It means dependable, consistency or stability.

Answer 12

Reliability

Question 13

Defined as one on which test takers fall in the same positions relative to each other.

Answer 13

Reliable test

Question 14

Reliability assumes that test scores reflect 2 factors which are:

Answer 14

True characteristics
Random measurement of error

Question 15

Stable characteristics of the individual.

Answer 15

True characteristics

Question 16

Chance features of the individual or the situation.

Answer 16

Random measurement of error

Question 17

Tools used to estimate or infer the extent to which an observed score deviates from a true score.

Answer 17

Standard error of estimates/measurement

Question 18

Mathematical representation of Random Measurement error

Answer 18

X= T+E

Question 19

In a reliable test, the value of E should be close to _ and the value of T should be close to the _.

Answer 19

0
Actual test score X.

Question 20

Formula for the proportion of test score reflecting a person’s true characteristics.

Answer 20

T/X

Question 21

Formula for the proportion of test score reflecting random error.

Answer 21

E/X

Question 22

The reliability of the test is actually based on _.

Answer 22

Performance of people

Question 23

Difference between people in test scores reflect differences between them in _ plus differences in the effect of _ factors.

Answer 23

Actual knowledge/characteristics
Chance factors

Question 24

What are the sources of error variance?

Answer 24

Test construction
Test administration
Test scoring and interpretation
Other sources of error

Question 25

It correlates performance on two interval scale measures and uses that correlation to indicate the extent of true score differences.

Answer 25

Reliability Analysis

Question 26

Used to evaluate the error associated with administering a test at two different times.

Answer 26

Test-retest method

Question 27

The test retest method is of value only when we measure traits or characteristics that _.

Answer 27

Do not change overtime.

Question 28

Ideally, test-retest method should have _ months or more interval.

Answer 28

6

Question 29

When the interval between testing is greater than 6 months.

Answer 29

Coefficient of stability

Question 30

It compares two equivalent forms of a test that measures the same attribute.

Answer 30

Parallel/Alternative forms method

Question 31

The 2 forms in parallel/ alternative forms method use _ items while the rules used to select items of a particular difficulty level are _. (Same/Different)

Answer 31

Different Same

Question 32

A test is given to some and divided into halves that are scored separately.

Answer 32

Split half method

Question 33

One subscore is obtained for the odd number items in the test and another for the even-numbered items. Used in split half method.

Answer 33

Odd-even system

Question 34

Allows you to estimate what the correlation between the 2 halves would have been if each half had been the length of the whole test.

Answer 34

Spearman-Brown Formula

Question 35

Refers to the degree of correlation among all the items on a scale.

Answer 35

Inter-item consistency

Question 36

Inter item consistency is calculated using _ administration of a _ test form. (frequency)

Answer 36

Single

Question 37

Inter item consistency is useful in assessing the _ of a test.

Answer 37

Homogeneity

Question 38

What are the methods used to obtain estimates of interval consistency?

Answer 38

KR 20 Cronbach alpha

Question 39

Cronbach developed a more general reliability estimate which he called _.

Answer 39

Cronbach alpha

Question 40

Cronbach alpha typically range from _ to _, _ values are theoretically impossible.

Answer 40

0-1 Negative values

Question 41

The degree of agreement or consistency between two or more scorers with regard to a particular measure.

Answer 41

Inter-scorer reliability

Question 42

Inter-scorer reliability is for what kinds of test?

Answer 42

Creativity or projective test

Question 43

Judgment or estimate of how well a test measures what it purports to measure in a particular measure.

Answer 43

Validity

Question 44

A judgment based on evidence about the appropriateness of inferences drawn from rest scores.

Answer 44

Validity

Question 45

Process of gathering and evaluating evidence about validity.

Answer 45

Validation

Question 46

Validation process if test users plan to alter format, instruction, language or content of the test. Example is the national standardized test to braille

Answer 46

Local validation.

Question 47

As reliability of the test increases, the highest possible value of _ increases.

Answer 47

Validity coefficient

Question 48

What are the 5 measures of reliability?

Answer 48

Test retest method Parallel/Alternative forms method Split-half method Inter-item consistency Inter-scorer Reliability

Question 49

The first theory behind validity analysis is that the true score component reflects factors producing _ in test scores while E, error reflects factors producing _ in test scores.

Answer 49

Stability Instability

Question 50

The second theory behind validity analysis is focused specifically on the variable producing _ differences.

Answer 50

True score differences.

Question 51

What are the 2 components of true score?

Answer 51

Stable characteristics of individual relevent to the purpose of the test. Stable characteristics of individual irrelevant to the purpose of the test.

Question 52

Formula of systematic measurement error.

Answer 52

R+I = T

Question 53

Formula of both error components (systematic and random error)

Answer 53

X= R + I + E

Question 54

When the item looks like they measure what they are supposed to measure.

Answer 54

Face Validity

Question 55

The judgment about the item appropriateness in face validity is made by _.

Answer 55

Test takers

Question 56

It is important whenever a test is used to make inferences about the broader domain of knowledge or skills represented by a sample of items.

Answer 56

Content validity

Question 57

Content validity is important to what kinds of performance test?

Answer 57

Maximal and Typical Performance Test

Question 58

The ability of a test to predict performance in another measure.

Answer 58

Criterion Validity

Question 59

In criterion Validity, the test is referred to as the _ labeled X and the validation measure as the _ labeled Y.

Answer 59

Predictor; Criterion

Question 60

It is important whenever a test is used to make decisions by predicting future performance.

Answer 60

Criterion Validity

Question 61

A judgment of how adequately a test score can be used to infer an individual's most probable standing on some measure of interest- being the criterion.

Answer 61

Criterion- related Validity

Question 62

What are the 2 types of validity evidence?

Answer 62

Predictive validity Concurrent validity

Question 63

An index of the degree to which a test score predicts some criterion measure. Type of validity evidence.

Answer 63

Predictive validity

Question 64

An index of the degree to which a test score is related to some criterion measure obtained at the same time (concurrently)

Answer 64

Concurrent validity

Question 65

Used whether a test measures what it is intended to measure. Referred to as the personality dimension of personality traits.

Answer 65

Construct validity

Question 66

What are the 2 construct validation techniques?

Answer 66

Congruent validity Discriminant or divergent validity

Question 67

Construct validation technique that measures correlating the same construct.

Answer 67

Congruent validity

Question 68

Construct validation technique that measures correlating it to inconsistent constructs.

Answer 68

Discriminant or divergent validity

Question 69

An informed, scientific idea developed or hypothesized to describe or explain behavior.

Answer 69

Construct

Question 70

What are the 5 types of validity?

Answer 70

Face validity Content validity Criterion Validity Criterion- related Validity Construct validity

Question 71

What are the statistical test bias?

Answer 71

Intercept bias Slope bias

Question 72

A judgement resulting from the intentional or unintentional misuse or rating scale.

Answer 72

Rating error

Question 73

Error in rating that arises from the tendency on the part of the rater to be lenient in scoring.

Answer 73

Leniency Error

Question 74

Systematic reluctance to giving ratings at either positive or negative.

Answer 74

Central Tendency Error

Question 75

Tendency to give a particular ratee a higher rating than he of she objectively deserves because the rater's failure to discriminate among conceptually distinct aspects of a ratee's behavior.

Answer 75

Halo effect

Question 76

The extent to which a test is used in an impartial, just and equitable way.

Answer 76

Fairness

Question 77

Refers to a group of statistics that can be calculated for individual test items.

Answer 77

Item analysis

Question 78

What are the 2 commonly used techniques of item analysis?

Answer 78

Item Difficulty Item Discrimination

Question 79

A commonly used technique of item analysis that is appropriate for maximal performance test achievement and aptitude test. It requires that test items be scored as correct and incorrect.

Answer 79

Item Difficulty

Question 80

Percentage of the pupils who got the item right. It can also be interpreted as how easy or how difficult an item is.

Answer 80

Difficulty Index/ Item Difficulty Index

Question 81

Formula for Item Difficulty index

Answer 81

P= number of person answering item correctly/ N (total number of people taking the test)

Question 82

What is the value for optimal item Difficulty?

Answer 82

Between .5-.7

Question 83

What does a high p value mean in item difficulty index?

Answer 83

Most people are correct on the item.

Question 84

What does a low p value mean in item difficulty index?

Answer 84

Most people answered the item incorrectly.

Question 85

Table of equivalent in interpreting the difficulty index: _= Very difficult .21-.80= moderately difficult .81-1.00= _.

Answer 85

.00-.20 Very easy

Question 86

The presence of many items at the _ level limits the potential reliability and validity of the test.

Answer 86

0

Question 87

The presence of many items at _ level reduces variability and limits the test's potential reliability and validity.

Answer 87

1

Question 88

A commonly used technique of item analysis that is appropriate for almost any type of test. It indicates the extent to which different types of people answer an item in different ways.

Answer 88

Item Discrimination

Question 89

It separates the bright test takers from the poor ones.

Answer 89

Discrimination Index

Question 90

What are the 2 approaches for measures of item Discrimination?

Answer 90

Item discrimination index Item-total correlation

Question 91

The proportion obtained by comparing the performance of 2 subgroups of test takers, used in maximal performance testing. Also known as D.

Answer 91

Extreme Group Method