Reliability

Question 1

Tests that are free from measurement of error

Answer 1

Reliable

Question 2

measurements are consistent, or repeatable

Answer 2

Reliability

Question 3

who pioneered reliability

Answer 3

Charles Spearman

Question 4

Measurement of instruments are imperfect thus we use this formula

Answer 4

X= T+E

Question 5

problems created by using a limited number of items to represent a larger more complicated construct

Answer 5

domain sampling model

Question 6

it is the ratio of variance of the observed score on the shorter test and the variance of the long run true score

Answer 6

reliability

Question 7

focuses on an item difficulty to assess the ability

Answer 7

Item Response Theory

Question 8

it is an index of reliability

Answer 8

Reliabilitycoefficient

Question 9

a proportion that indicates the ratio between the true score variance on a test and the total variance

Answer 9

reliability coefficient

Question 10

Sources of Error

Answer 10

Test Construction , Test Administration, Test Scoring and I

Question 11

another name for test retest reliability estimate

Answer 11

Time Sampling Method

Question 12

obtained by correlating pairs of scores from the same people on 2 different administrations of the same test

Answer 12

Test-Retest Reliability Estimate

Question 13

The estimate of test retest reliability is

Answer 13

coefficient of stability

Question 14

it exists when for each form of the test the means and the variances of the observed score test acores are equal

Answer 14

Parallel Forms and Alternating Forms Reliability

Question 15

obtained by correlating 2 pairs of scores obtained from equivalent halves of a single test administered once

Answer 15

Split Half Reliability Estimates

Question 16

Steps in Split Half Reliability

Answer 16

1. Divide the test into equivalent halves 2. Calculate Pearson r bet. scores of the 2 halves of the test 3. Adjust the half test reliability using Spearman Brown Formula

Question 17

refers to the degree of correlation among all items on a scale

Answer 17

Inter item consistency

Question 18

it measures a single trait

Answer 18

Homogenous Test

Question 19

Used when the items are highly homogenous and is the same result with split half reliability

Answer 19

KR-20 formulas

Question 20

reliability criteria that doesn’t require calculation of p and q

Answer 20

KR21

Question 21

item difficulty in KR21

Answer 21

average of 50%

Question 22

the mean of all possible split-half correlations,

Answer 22

Coefficient Alpha

Question 23

Coefficient alpha is corrected by what

Answer 23

Spearman-Brown Formula

Question 24

how to increase relia ility?

Answer 24

• increase the number of items or observations. -Eliminate items that are unclear. -Standardize the conditions under whixh the test is taken. -Moderate the degree of difficulty of the tests. -Minimize the effects of external events. -Standardize the instructions -Maintain a consistent scoring procedures

Question 25

type of reliabilty that measures stability

Answer 25

test retest

Question 26

type of reliabilty that measures equivalence

Answer 26

Parallel or Alternate Forms

Question 27

type of reliabilty that measures Agreement

Answer 27

Inter-rater

Question 28

type of reliabilty that measures consistency of each item in the underlying construct

Answer 28

Internal consistency

Question 29

Statistical Computation for Test-retest

Answer 29

Correlation (Pearson r or Spearman ro)

Question 30

Statistical Computation for Stability

Answer 30

Correlation (Pearson r or Spearman rho)

Question 31

Statistical Computation for equivalence

Answer 31

Correlation, Pearson r or Spearman rho

Question 32

Statistical Computation for parallel or alternate forms

Answer 32

Correlation (Pearson r or Spearman rho)

Question 33

Statistical Computation for Agreement

Answer 33

Percentage and Kappa's coefficient

Question 34

Statistical Computation for inter rater

Answer 34

Percentage and Kappa's coefficient

Question 35

Statistical Computation for Internal Consistency

Answer 35

Cronbach's Alpha , Kuder Richardson, Ordinal/Composite

Question 36

Statistical Computation for Consistency

Answer 36

Cronbach's Alpha,Kuder-Richardson,Ordinal/Composite

Question 37

it is usually an internal consistency of alpha as index

Answer 37

.70

Question 38

Newly developed should not have what consistency

Answer 38

should not have internal consistency of .90 and above

Question 39

modest reliabilty

Answer 39

.60 - .69

Question 40

Considerations in the use and purpose of reliability coefficients

Answer 40

homogeneity vs heterogeneity of test items. dynamic vs static characteristics. Speed test vs Power test