Methods and Validation Flashcards
(13 cards)
What tests and instruments can we use to test the validity of job analysis?
Psychometric tests Work simulations Interviews Application forms Assessment centers
Features of evaluation standards for personnel selection standards?
- Discrimmination
- validity of measures
- reliability of measures
- legality
- fairness
- cost effectiveness
What are the major sources of distortion in validation studies?
- Small sample size
- poor measurement precision due to unreliable tests
- restricted range of scores from a limited sample of respondents
What does the validity and reliability examine?
Examining the correlation between the selection method and
future performance of job holders
Examining the candidate’s reaction to the selection process
itself
Reliability of the measure or method refers to whether your test
returns consistent results across different situations
Describe the most important type of validity
The Criterion related validity is the most important type of validity and it does the selection method based on identifying specific
predictors predict later work performance.
List the types of validities
- faith
- incremental
- face
- content
- construct
Describe the faith validity
Valid because of how it is packaged and presented
and the status of the developer
Describe the Incremental Validity
assesses how much better at predicting performance would
we be if we included one more predictor
Describe the face Validity
This test looks like it is right. Refers to the acceptability
of the measure, like the MBTI
Describe the Content Validity
Measures of the predictor cover a representative
sample of all relevant behaviours being measured
e.g., all actions a manager should perform
Describe the Construct Validity
Established by correlation; seeing how well one wellknown measure correlates with another for the
predictor in question
What are the reliability types?
-test-retest: External form of reliability where you are
expected to score consistently on the test at
time 1 and time 2
-parallel forms: External form of reliability where you are
expected to score the same on two different
versions of the test
-internal: e.g., Cronbach’s alpha coefficient or splithalf method are internal reliability measures
that depend on statistical techniques to
determine how consistent a measure is
What factors are used to access the usability of selection methods
Cost effectiveness can be determined by
Selection ratio – number of hired candidates/ number of
applicants
Financial benefit of improved performance
Selection ratio – you want to hire as many people as you can
who will perform well and as few people who will not perform
well. If your predictors are good, chances of hiring people
who don’t perform well are reduced – false positives reduced.