Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PSY 4310 > UTILITY > Flashcards

UTILITY Flashcards

1
Q

the practical value of testing to improve efficiency
a. Reliability
b. Validity
c. Utility

A

c. Utility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

“How useful is this test as compared to another test”
a. Comparative utility
b. Treatment utility
c. Diagnostic Utility

A

a. Comparative utility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

“Is the use of this test followed by better intervention results?”
a. Comparative utility
b. Treatment utility
c. Diagnostic Utility

A

b. Treatment Utility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

“How useful is it for classification purposes”
a. Comparative utility
b. Treatment utility
c. Diagnostic Utility

A

c. Diagnostic Utility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the factors affecting utility?

A

Psychometric soundness, costs and benefits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How can you say that a test score has utility?
a. it can be used everyday
b. it is cost-effective
c. it can be used in work

A

b. it is cost effective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the relationship between validity and utility?
a. Direct
b. Inverse
c. Not Sure

A

a. Direct (The higher the criterion-related validity of test scores for making a particular decision, the higher the utility of the test is likely to be.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

True or False
Valid tests are not always useful tests.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

One of the most basic elements of utility analysis is the financial cost associated with a test
a. Psychometric Soundess
b. Costs
c. Benefits

A

b. Costs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

To which do you allocate funds for in a test?
a. to a particulat test
b. a supply blank test protocols
c. computerized test processing scoring and interpretation
d. all of the above

A

d. all of the above

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which is harder to calculate in terms of costs?
a. Effective tests
b. Ineffective tests

A

b. Ineffective tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Refers to the profits, gains or advantages
a. Psychometric Soundess
b. Costs
c. Benefits

A

c. Benefits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A family of techniques that entail a cost–benefit analysis designed to yield information relevant to a decision about the usefulness and/or practical value of a tool of assessment.
a. Utility Analysis
b. Taylor-Russell Tables
c. Brogden-Cronbach-Gleser Formula

A

a. Utility Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the endpoint of an utility analysis?

A

to make an educated decision about which of many possible courses of action is optimal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

An assumption is made that high scores on one attribute can “balance out” or compensate for low scores on another attribute.
a. Selection of Compensatory Model
b. Model of Selection
c. Compensatory Model of Selection

A

c. Compensatory Model of Selection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

The likelihood that a test taker will score within some interval of scores on a criterion measure.
a. Criterion Data
b. Expectancy Data
c. Norms Data

A

b. Expectancy Data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Provide an estimate of the percentage of employees hired by the use of a particular test who will be successful at their jobs
a. Utility Analysis
b. Taylor-Russell Tables
c. Brogden-Cronbach-Gleser Formula

A

b. Taylor-Russell Tables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is in the Table of Taylor-Russell?

A

Validity of Coefficient, Selection Rate, and the Base Rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

used to calculate the dollar/peso amount of a utility gain resulting from the use of a particular selection instrument under specified conditions.
a. Utility Analysis
b. Taylor-Russell Tables
c. Brogden-Cronbach-Gleser Formula

A

c. Brogden-Cronbach-Gleser Formula

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the limitations of Taylor-Russell Tables?

A
  • the relationship between the the predictor (the test) and the criterion (rating of the performance on the job) must be LINEAR
  • difficult to identify between successful and unsuccessful employees
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

help obtain the difference between the means of the selected and unselected groups to derive an index of what the test (or some other tool of assessment) is adding to already established procedures.
a. Taylor-Russell Tables
b. Naylor-Shine Tables

A

b. Naylor-Shine Tables

21
Q

Utility gain is the
a. total benefit (or monetary) of using a particular test or selection method
b. estimate of the benefit (or monetary) of using a particular test or selection method

A

b. estimate of the benefit (or monetary) of using a particular test or selection method

22
Q

refers to an estimated increase in work output

A

productivity gain

23
Q

If the selection rate is higher, should the cut off score be higher as well?

A

No, cut-off score should be lower

24
Q

Which among the following is not part of the practical considerations when conducting utility analyses?
a. the pool of job applicants
b. the complexity of the job
c. the cut-off score
d. the difficulty of the test

A

d. the difficulty of the test

25
Q

Some utility models are based on the assumption that that there will be a ready supply of viable applicants from which to choose and fill positions.
a. The pool of job applicants
b. the complexity of the job
c. the cut-off score

A

a. the pool of job applicants

26
Q

How does utility estimates the pool of job applicants?
a. It assumes that most applicants will not accept the job
b. It assumes that the selected applicants will actually accept the offer of employment thus tend to overestimate the utility measurement tool
c. It randomize applicants who will accept the job so that the utility of measurement will be impartial

A

b. It assumes that the selected applicants will actually accept the offer of employment thus tend to overestimate the utility measurement tool

27
Q

True or False
The more complex the job, the more people differ on how well or poorly they do that job

A

True

28
Q

Why is relative cut score also called as norm-referenced score?
a. because this type of cut score is set with reference to a criterion
b. because this type of cut score is set with a new reference made by test developers
c. because this type of cut score is set with reference to the performance of a group

A

c. because this type of cut score is set with reference to the performance of a group

29
Q

minimum level of proficiency required to be included in a particular classification.
a. relative cut score
b. fixed cut score

A

b. fixed cut score

30
Q

used in a distribution of test score to divide a set of data into two or more classifications
a. relative cut score
b. fixed cut score
c. all of the above
d. none of the above

A

c. all of the above

31
Q

A high score can in fact, “balance out” or compensate for low scores on another attribute is from what model?
a. compensatory model of selection
b. los angeles models
c. multiple model of scores

A

a. compensatory model of selection

32
Q

The statistical tool that is ideally suited for making such selection decisions within the framework of a compensatory model is called
a. pearson correlation coefficient
b. chi-squared test
c. multiple regression

A

c. multiple regression

33
Q

Angoff Method and Known Groups Method are under
a. Classical Test Score Theory
b. IRT-Based Method
c. Method of Predictive Yield
d. Discriminant Analysis

A

a. Classical Test Score Theory

34
Q

The judgments of the experts are averaged to yield cut scores for the test.
a. Angoff Method
b. Known Groups Method
c. Item-Mapping Method
d. Bookmark Method

A

a. Angoff Method

35
Q

What’s the weakness of Angoff Method?
a. There is no criteria
b. If disagreement arises between raters
c. If the raters same scores

A

b. If disagreement arises between raters

36
Q

Entails collection of data on the predictor of interest from groups known to possess, and not to possess, a trait, attribute, or ability of interest.
a. Angoff Method
b. Known Groups Method
c. Item-Mapping Method
d. Bookmark Method

A

b. Known Groups Method

37
Q

Weakness of Known Groups Method
a. no guidelines for choosing contrasting groups
b. cut score can be placed anywhere
c. both a and b
d. no weakness

A

c. both a and b

38
Q

Item-Mapping and Bookmark Method is under
a. Classical Test Score Theory
b. IRT-Based Method
c. Method of Predictive Yield
d. Discriminant Analysis

A

b. IRT-Based Method

39
Q

In order to “pass” the test, the test taker must answer items that are deemed to be above some minimum level of difficulty, which is determined by experts and serves as the cut score.
a. Classical Test Score Theory
b. IRT-Based Method
c. Method of Predictive Yield
d. Discriminant Analysis

A

b. IRT-Based Method

40
Q

entails arrangement of items in a histogram with each column containing items deemed to be of equivalent value
a. Angoff Method
b. Known Groups Method
c. Item-Mapping Method
d. Bookmark Method

A

c. Item-Mapping Method

41
Q

experts place a bookmark between 2 items deemed to separate test takers who have acquired minimal knowledge, etc.
a. Angoff Method
b. Known Groups Method
c. Item-Mapping Method
d. Bookmark Method

A

d. Bookmark Method

42
Q

Typically used in academic set up
a. Item-Mapping Method
b. Bookmark Method

A

b. Bookmark Method

43
Q

took into account the number of positions to be filled, projections regarding the likelihood of offer acceptance, and the distribution of applicant scores.
a. Method of Predictive Yield
b. Discriminant analysis
c. Discriminant function analysis

A

a. Method of Predictive Yield

44
Q

A family of statistical techniques used to shed light on the relationship between identified variables and two naturally occurring groups
a. Method of Predictive Yield
b. Discriminant analysis
c. Personnel Psychology

A

b. Discriminant Analysis

45
Q

in Cognitive tests, a statistic indicating how many tests takers responded correctly to an Item

in personality tests, a statistic indicating how many test takers responded to an item in a particular direction

a. index of item difficulty
b. index of item discrimination
c. index of item reliability
d. index of item validity

A

a. index of item difficulty

46
Q

a statistic designed to indicate how adequately a test item discriminates between high and low scorers.
a. index of item difficulty
b. index of item discrimination
c. index of item reliability
d. index of item validity

A

b. index of item discrimination

47
Q

is equal to the product of the item-score standard deviation (s) and the correlation (r) between the item score and the total test score.

provides an indication of the internal consistency of a test
a. index of item difficulty
b. index of item discrimination
c. index of item reliability
d. index of item validity

A

c. index of item reliability

48
Q

statistic indicating the degree to which a test measures what it purports to measure;

the higher the item-validity index, the greater the test’s criterion-related validity.

a. spiral omnibus format
b. index of item discrimination
c. index of item reliability
d. index of item validity

A

d. index of item validity

49
Q

a test where the themes are spread out through the test and not together in one section.
a. spiral omnibus format
b. index of item discrimination
c. index of item reliability
d. index of item validity

A

a. spiral omnibus format

PSY 4310 (3 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions