Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PSY 4310 > VALIDITY > Flashcards

VALIDITY Flashcards

1
Q

a judgement or estimate of how well a test measures what it purports to measure in a particular context
a. Utility
b. Reliability
c. Validity

A

c. Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

the process of gathering and evaluating evidence about validity.
a. Validation
b. Content Validity
c. Face Validity

A

a. Validation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

may yield insights regarding a particular population of test takers as compared to the norming sample described in a test manual.
a. Validation
b. Local validation studies
c. construct validity

A

b. Local validation studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the three categories that often conceptualize validity?

A
  • Content validity
  • Criterion-related validity
  • Construct validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the Trinitarian view?

A

Classic Conception of Validity
- Content
- Criterion
- Construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

this measure of validity is based on an evaluation of the subjects, topics, or content covered by the items in the test.
a. content validity
b. criterion-related validity
c. construct validity

A

a. content validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

this measure of validity is obtained by evaluating the relationship of scores obtained on the test to scores on other tests or measures
a. content validity
b. criterion-related validity
c. construct validity

A

b. criterion-related validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How scores on the test relate to other test scores and measures.
a. content validity
b. criterion-related validity
c. construct validity

A

c. construct validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

a judgment concerning how relevant the test items appear to be.
a. Validation
b. Face Validity
c. Test blueprint

A

b. Face Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

a judgement of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample.
a. Content validity
b. test blueprint
c. content validity ratio

A

a. Content validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Necessary to consider a content-valid measure of test
a. clinical setting
b. industrial setting
c. educational setting

A

c. educational setting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Give examples of topics where it may have different validations from different people/places.

A

Politics, History,Cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

a plan regarding the types of information to be covered by the items, the number of items tapping each area of coverage, the organization of the items in the test, etc.
a. content validity
b. test blueprint
c. content validity ratio

A

b. test blueprint

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

measures agreement among raters regarding how essential an individual test item is for inclusion in a test
a. content validity
b. test blueprint
c. content validity ratio

A

c. content validity ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Values of content validity ration can range from

A

-1 to +1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

True or False
Closer to +1 = majority of experts agree there is an association between the item and the domain

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

the standard against which a test or a test score is evaluated.
a. Norm
b. Score
c. Criterion

A

c. Criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the characteristics of an adequate criterion?

A
  • RELEVANT to the matter at hand
  • VALID for the purpose for which it is being used
  • UNCONTAMINATED
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

A judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest (i.e., the criterion).
a. criterion-relation validity
b. concurrent validity
c. predictive validity

A

a. criterion-relation validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

An index of the degree to which a test score is related to some criterion measure obtained at the same time.
a. criterion-relation validity
b. concurrent validity
c. predictive validity

A

b. concurrent validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

An index of the degree to which a test score predicts some criterion, measure.
a. criterion-relation validity
b. concurrent validity
c. predictive validity

A

c. predictive validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

If a criterion contamination occurs, should you continue your study?

A

No, because the study cannot be taken seriously. There are no methods or statistics to correct for such contamination.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

“How well does Test A compare with Test B?” Which of the test is used as the validating criterion?

A

Test B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

percentage of people hired under the existing system for a particular position extent to which a particular trait, behavior, characteristic or attribute exists in the population expressed in proportion;
a. Hit rate
b. Miss Rate
c. Base Rate
d. Selection Ratio

A

c. Base Rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Proportion of people a test accurately identifies a possessing/exhibiting a particular trait, behavior/ characteristic/attribute
a. Hit rate
b. Miss Rate
c. Base Rate
d. Selection Ratio

A

a. Hit Rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Proportion of people the test fails to identify as having/ not having a particular characteristic/ attribute
a. Hit rate
b. Miss Rate
c. Base Rate
d. Selection Ratio

A

b. Miss Rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

numerical value that reflects the relationship between the number of people to be hired and the number of people available to be hired;
a. Hit rate
b. Miss Rate
c. Base Rate
d. Selection Ratio

A

d. Selection Ratio

28
Q

Miss Rate can be subdivided into:

A

False Positive (Type 1) and False Negative (Type 2)

29
Q

a miss wherein the test predicted that the examinee did possess the particular characteristic/ attribute being measured when the examinee did not.
a. Type 1 Error
b. Type 2 Error

A

a. Type 1 Error (False Positive)

30
Q

a miss wherein the test predicted that the examinee did not possess the particular characteristic/ attribute being measured when the examinee did.
a. Type 1 Error
b. Type 2 Error

A

b. Type 2 Error (False Negative)

31
Q

A correlation coefficient that provides a measure of the relationship between test scores and scores on the criterion measure.
a. Validity coefficient
b. Incremental validity

A

a. Validity coefficient

32
Q

The degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use
a. Validity coefficient
b. Incremental validity

A

B. Incremental validity

33
Q

Commonly used correlation coefficient to determine the validity between the two measures.
a. Pearson
b. Spearman rho
c. Chi-square

A

a. Pearson

34
Q

Correlation coefficient that is used for ordinal values
a. Pearson
b. Spearman rho
c. Chi-square

A

b. Spearman rho

35
Q

Correlation coefficient that is used for nominal values
a. Pearson
b. Spearman rho
c. Chi-square

A

c. Chi-square

36
Q

Correlation coefficient that is used for ratio/interval values
a. Pearson
b. Spearman rho
c. Chi-square

A

a. Pearson

37
Q

How high should a validity coefficient be for a user or a test developer to infer that the test is valid?

A

There are no rules. However, Cronbach & Glesser said that validity coefficients need to be large enough and high enough to allow accurate decisions.

38
Q

A quantitative estimate of incremental validity can be obtained using a statistical procedure called ___________

A

hierarchical regression

39
Q

Predictive validity that can measure academic success in college
a. Validity coefficient
b. Incremental Validity

A

b. incremental validity

40
Q

Judgement about the appropriateness of inferences drawn from test scores regarding individual standings on a construct
a. construct validity
b. criterion-related validity

A

a. construct validity

41
Q

True or False
If a test is a valid measure of a construct, then high scorers and low scorers should behave as theorized.

A

True

42
Q

An informed, scientific idea developed or hypothesized to describe or explain a behavior.
a. Attitude
b. Theory
c. Construct

A

c. Construct

43
Q

True or False
Constructs are observable

A

False
Constructs are unobservable

44
Q

How uniform a test is in measuring a single concept.
a. Evidence of homogeneity
b. Evidence of changes with age
c. Evidence of pretest - posttest changes
d. Evidence from distinct groups

A

a. Evidence of homogeneity

45
Q

Some constructs are expected to change over time (e.g., reading rate).
a. Evidence of homogeneity
b. Evidence of changes with age
c. Evidence of pretest - posttest changes
d. Evidence from distinct groups

A

b. Evidence of changes with age

46
Q

Test scores change as a result of some experience between a pretest and a posttest (e.g., therapy).
a. Evidence of homogeneity
b. Evidence of changes with age
c. Evidence of pretest - posttest changes
d. Evidence from distinct groups

A

c. Evidence of pretest - posttest changes

47
Q

Scores on a test vary in a predictable way as a function of membership in some group.
a. Evidence of homogeneity
b. Evidence of changes with age
c. Evidence of pretest - posttest changes
d. Evidence from distinct groups

A

d. Evidence from distinct groups

48
Q

Scores on the test undergoing construct validation tend to correlate highly in the predicted direction with scores on older, more established tests designed to measure the same (or a similar) construct.
a. Convergent evidence
b. Discriminant evidence

A

a. Convergent evidence

49
Q

Validity coefficient showing little relationship between test scores and/or other variables with which scores on the test should not theoretically be correlated
a. Convergent evidence
b. Discriminant evidence

A

b. Discriminant evidence

50
Q

The matric or table that results from correlating variables (traits) within and between methods.
a. convergent validity
b. multitrait-multimethod matrix

A

b. multitrait-multimethod matrix

51
Q

the correlation between measures of the same trait but different methods
a. convergent validity
b. discriminant validity
c. method variance

A

a. convergent validity

52
Q

the correlations of different traits via different methods are near zero
a. convergent validity
b. discriminant validity
c. method variance

A

b. discriminant validity

53
Q

Correlations of different traits via the same method and the similarity of scores is due to the use of the same method
a. convergent validity
b. discriminant validity
c. method variance

A

c. method variance

54
Q

Class of mathematical procedures designed to identify specific variables on which people may differ.
a. convergent evidence
b. discriminant evidence
c. factor analysis

A

c. factor analysis

55
Q

occurs when the use of a predictor results in consistent underprediction or overprediction of a specific group’s performance or outcomes.
a. intercept bias
b. slope bias

A

a. intercept bias

56
Q

occurs when a predictor has a weaker correlation with an outcome for specific groups
a. intercept bias
b. slope bias

A

b. slope bias

57
Q

A factor inherent in a test that systematically prevents accurate, impartial measurement.
a. bias
b. rating error
c. halo effect
d. fairness

A

a. bias

58
Q

numerical or verbal judgement that places a person or an attribute along a continuum identified by a scale of numerical or word descriptions known as rating scale

A

rating

59
Q

A judgment resulting from the intentional or unintentional misuse of a rating scale.
a. bias
b. rating error
c. halo effect
d. fairness

A

b. rating error

60
Q

an error in rating that arises from the tendency on the part of the rater to be lenient in scoring, marking and or grading
a. leniency error
b. centrality tendency error
c. severity error

A

a. leniency error

61
Q

Movie critics who pan just about everything they review may be guilty of ______
a. leniency error
b. centrality tendency error
c. severity error

A

C. severity error

62
Q

the rater exhibits a general and systematic reluctance to giving ratings at either the positive or negative extreme
a. leniency error
b. central tendency error
c. severity error

A

b. central tendency error

63
Q

To overcome what might be termed restriction-of-range rating errors is to use _____

A

rankings

64
Q

A tendency to give a particular person a higher rating than he or she objectively deserves because of a favorable overall impression.
a. bias
b. rating error
c. halo effect
d. fairness

A

c. halo effect

65
Q

The extent to which a test is used in an impartial, just, and equitable way.
a. bias
b. rating error
c. halo effect
d. fairness

A

d. fairness

66
Q

True or False
It is bias if the the test takers are not from the standardized sample.

A

False.
The sheer fact that no members of a particular group were included in the standardization sample does NOT in itself invalidate the test for use with that group

67
Q
A

PSY 4310 (3 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions