Utility

Question 1

The practical value of using a test to aid in decision making and improve efficiency. It also refers to the practical value of a training program or intervention.

Answer 1

Utility

Question 2

The practical value of the information derived from scores of the test.

Answer 2

Index of utility

Question 3

The higher the _ validity of test scores for making a particular decision, the higher the utility of the test is likely to be.

Answer 3

Criterion- related validity

Question 4

The disadvantages, losses of expenses in both economic and non economic terms. It is the expenditures associated with testing or not testing.

Answer 4

Costs

Question 5

It refers to profits, gains or advantages. It should justify the costs of administering, scoring and interpreting the test.

Answer 5

Benefits

Question 6

It may be undertaken for the purpose of evaluating whether the benefits of using a test outweight the costs.

Answer 6

Utility analysis

Question 7

Provides an estimate of the extent to which inclusion of a particular test in the selection system will improve selection. The tables provide an estimate of the percentage of employees hired by the use of a particular test who will be successful at their jobs.

Answer 7

Taylor-Russell tables

Question 8

The computed validity coefficient in Taylor-Russell tables.

Answer 8

Test’s validity

Question 9

The numerical value that reflects the relationships between the number of people to be hired and the number of people available to be hired in Taylor-Russell tables.

Answer 9

Selection Ratio

Question 10

It is the percentage of people hired under the existing system for a particular position, in the Taylor-Russell tables.

Answer 10

Base Rate

Question 11

What are the 3 variables in Taylor-Russell tables?

Answer 11

Test’s validity
Selection Ratio
Base rate

Question 12

One limitation of the Taylor-Russell tables is that the relationship between the predictor (test) and the criterion (rating of performance) must be _.

Answer 12

Linear

Question 13

Entails obtaining the difference between the means of the selected and unselected groups to derive an index of what the test is adding to already established procedures. Used in utility analysis.

Answer 13

Naylor-Shine tables

Question 14

The Naylor-Shine tables determine the increase in average score on some criterion measure while the Taylor-Russell determine the increase over _ procedures.

Answer 14

Current

Question 15

The validity coefficient with both the Taylor-Russell and the Naylor-Shine tables must be obtained by _ validation procedures.

Answer 15

Concurrent validation

Question 16

It is used to calculate the dollar amount of a utility gain resulting from the use of a particular selection instrument under specified conditions.

Answer 16

The Brogden-Cronbach-Gleser formula

Question 17

It refers to an estimate of the benefit of using a particular test or selection method.

Answer 17

Utility gain

Question 18

The estimated increase in work output.

Answer 18

Productivity gain

Question 19

The value of a test lies in the extent to which its use improves the _ that exists without its use.

Answer 19

Hit rate

Question 20

It means correct classification.

Answer 20

Hit

Question 21

Incorrect classification.

Answer 21

Miss

Question 22

The proportion of people that an assessment tool accurately identifies as possessing or exhibiting a particular trait, ability, behavior or attribute.

Answer 22

Hit rate

Question 23

The proportion of people that an assessment tool inaccurately identifies as possessing or exhibiting a particular trait, ability, behavior or attribute.

Answer 23

Miss rate

Question 24

A specific type of miss whereby an assessment tool falsely indicates that the testtaker possesses or exhibit a particular trait, ability, behavior or attribute.

Answer 24

False positive

Question 25

A specific type of miss whereby an assessment tool falsely indicates that the testtaker does not possess or exhibit a particular trait, ability, behavior or attribute.

Answer 25

False negative

Question 26

If the selection ratio is high, the cut-off score will be higher. There will be many _.

Answer 26

False positives

Question 27

If the selection ratio is low, the cut-off score will be higher. There will be many _.

Answer 27

False negatives

Question 28

_ theory provides guidelines for setting an optimal cutoff score.

Answer 28

Decision theory

Question 29

Period of high unemployment there are significantly more people in the pool of possible job applicants than in periods of high employment.

Answer 29

Economic climate

Question 30

It is usually a numerical reference point derived as a result of a judgment and used to divide a set of data into two or more classifications, with some to be taken or some inference to be made on the basis of these classifications.

Answer 30

Cut score

Question 31

A type of cut score. It is the reference point that is set based on norm-related consideration.

Answer 31

Relative cut score or norm-referenced cut score.

Question 32

A type of cut score. It is a reference point that is typically set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification.

Answer 32

Fixed cut score or absolute cut score

Question 33

A type of cut score that refers to the use of two or more cut scores with reference to one predictor for the purpose of categorizing testtakers.

Answer 33

Multiple cut score

Question 34

It is one collective element of a multistage decision-making process in which the achievement of a particular cut score on one test is necessary in order to advance to the next stage of evaluation in the selection process.

Answer 34

Multiple Hurdle

Question 35

High scores on one attribute can balance out or compensate for low scores on another attribute.

Answer 35

Compensatory model of selection

Question 36

It is the statistical tool that is ideally suited for making selection decisions within the framework of a compensatory model.

Answer 36

Multiple regression

Question 37

Different types of cut scores:

Answer 37

Relatively cut score or norm referenced cut score Fixed cut score or absolute cut scores Multiple scores Multiple Hurdle

Question 38

What are the methods for setting cut scores?

Answer 38

The Angoff Method The Known Groups Method or the Method of contrasting Groups IRT Based Methods Methods of Predictive yield Discriminant Analysis or Discriminant Function Analysis

Question 39

The Angoff Method was devised by _.

Answer 39

William Angoff

Question 40

It is a method of setting cut scores that can be applied to personnel selection tasks as well as to questions regarding the presence of absence of a particular trait, attribute or ability.

Answer 40

The Angoff Method

Question 41

In Angoff Method, they are the one who provide estimates regarding how testtakers who have atleast minimal competence for the position should answer the items correctly.

Answer 41

Experts

Question 42

The weakness of Angoff Method is when there is a low _ reliability.

Answer 42

Inter-rater reliability

Question 43

A method for setting cut scores that entails collection of data on the predictor of interest from groups known to possess and not to possess a trait, attribute or ability of interest. The cut score is set on the test that best discriminates the 2 group's performance.

Answer 43

The Known Groups Method or the Method of Contrasting Groups

Question 44

Cut scores are based on testtaker's performance across all items on the test. Some portion of the total number of items on the test must be scored "correct" in order for the testatker to pass the test.

Answer 44

Classical test score theory

Question 45

Within this theory framework-based methods of setting a cut score, each item is associated with a particular level of difficulty. The test takers must answer items that are deemed to be above some minimum level of difficulty which is determined by experts and serves as the cut score.

Answer 45

Item-response theory (IRT)

Question 46

What are the 2 IRT-based methods for determining the difficulty level reflected by a cut score?

Answer 46

Item-mapping method Bookmark method

Question 47

IRT based method that includes arrangement of items in a histogram with each column in the histogram containing items deemed to be of equivalent value.

Answer 47

Item-mapping method

Question 48

An IRT based method that begins with the training of experts with regard to the minimal knowledge, skills and/or abilities that testtakers should possess in order to pass. The experts are given a book of items, arranged in an ascending order of difficulty. They place bookmarks between the 2 pages that are deemed to separate minimal knowledge from those who have not. Bookmark served as the cut score.

Answer 48

Bookmark method

Question 49

A technique for setting cut scores which took into account the number of positions to be filled, projections regarding the likelihood of offer acceptance, and the distribution of applicant scores.

Answer 49

Method of Predictive Yield

Question 50

A method for setting cut scores that is used to shed light on the relationship between identified variables and two naturally occurring groups.

Answer 50

Discriminant Analysis or Discriminant Function Analysis