Predicting Employee Performance: The Predictor Problem Flashcards
In the context of selecting predictors of job performance, _________________ refers to the extent to which performance on a measure is unaffected by measurement error, while ____________ refers to the degree to which the measure assesses what it was designed to asses.
- Reliability
- Validity
There are three types of validity: _______________, __________________, and __________________; the type of greatest concern depends on the nature and purpose of the predictor. In I/O, a predictor’s _____________ validity is usually of particular interest.
- Content
- Construct
- Criterion-related
- Criterion-related
There are ___ steps involved in evaluating a predictor’s criterion-related validity.
7.
Step 1: ___________________: Identify the knowledge, skills, abilities, and other characteristics required for successful job performance.
Conduct a job analysis.
Step 2: ________________ - Select/develop a predictor that measures the attributes identified by the job analysis.
Select or develop the predictor.
Step 3: ____________________ - Administer the predictor to a sample of job applicants (predictive validity) or current employees (concurrent validity); obtain criterion information for all individuals in the sample.
Administer the predictor and assess the criterion.
Step 4: ___________________ - Calculate the criterion-related validity coefficient to determine if there is a statistically significant relationship between predictor and criterion scores.
Correlate the predictor and criterion scores.
Step 5: __________________ - Determine if the predictor will have adverse impact - i.e., if use of the predictor will discriminate against a legally protected class of individuals.
Check for adverse impact.
Step 6: ____________________ - Determine if use of the predictor will increase the proportion of correct decisions.
Evaluate incremental validity.
Step 7: _________________ - Perform steps 3 through 6 with a new sample. Because all of the chance factors that maximized the original validity coefficient are not present in the second sample, the cross-validation coefficient is usually smaller than the original coefficient. This phenomenon is referred to as _______________.
- Cross-validate
- Shrinkage
Title ___ of the _______________ Acts of 1964 and other legislation prohibit discrimination in hiring, placement, training, promotion, and retention on the basis of race, religion, gender, national origin, age, or disability. The provision of these laws are enforced by the ____________________ (EEOC), which issued the Unified Guidelines on Employee Selection Procedures.
- VII
- Civil Rights
- Equal Employment Opportunity Commission
As defined by the Uniform Guidelines, a selection test or other employment procedure is discriminating against members of a legally protected group - i.e., is having an ______________ - when use of that procedure results in a substantially different selection, ____________, or promotion rate for members of that group.
- Adverse impact
- Placement
The ________________ is often used to determine if a procedure is having an adverse impact. The hiring rate for the majority group is multiplied by 80% to determine the minimum hiring rate for the minority group. As an example, if use of a test results in a 50% hiring rate for African Americans and 90% rate for whites, the test would be having an adverse impact for African Americans because 90% times 80% is 72%, which is greater than the hiring rate for African Americans.
80% (Four-Fifths) Rule.
Bonus: The 4/5 Rule requires that for a finding of adverse impact, a pattern of discrimination must be established.
______________________ occurs when a measure is valid for one group but is not valid (or is significantly less valid) for another group. The characteristic that distinguishes between the two groups - e.g., gender, race, or age - is referred to as a ____________ variable.
- Differential validity
- Moderator
_____________ occurs when members of one group consistently obtain lower scores on the predictor than members of another group, but the difference in predictor scores is NOT related to differences in scores on the criterion.
Unfairness.
When the plaintiff in a class-action suit demonstrates that an employment procedure is having an adverse impact, the burden of proof has traditionally been on the _______________ to show that use of the procedure _______ discriminatory.
- Employer
- Is not
Defense against ruling of adverse impact: _____________ - The employer must not only prove that the measure is job-related, but must also show that its use is required for the safe and efficient operation of the business.
Business necessity.
Defense against ruling of adverse impact: _________________ - The employer can show that the characteristic in question is an essential determinant of the genuineness of the job or when a person’s gender, etc., must be taken into consideration to maintain community standards of morality or propriety.
Bona Fide Occupational Qualification (BFOQ).
__________________ refers to the increase in decision-making accuracy an employer will achieve by using the predictor to make selection decisions.
Incremental validity.
The _______________ is the ratio of job openings to job applicants. For example, a ratio of 1:50 indicates that there is one job opening for every 50 job applicants. A _____ ratio is preferred since it allows an employer to be more selective when making hiring decisions.
- Selection ratio
- Low
The ______________ is the percent of employees who are performing satisfactorily without use of the proposed predictor and ranges in value from 0 to 1.0. ______________ rates (rates close to .50) are associated with the greatest incremental validity.
- Base rate
- Moderate
The _________________ can be used to estimate the percent of new hires that will be successful as employees given various combinations of validity coefficients, selection ratios, and base rates.
Taylor-Russel Tables.
When using _______________, predictor scores are weighted and summed to yield an estimated criterion score, with each predictor’s weight being determined by its correlation with criterion and with the other predictors. This strategy is compensatory, since exceptional performance on one predictor can offset poor performance on another predictor.
Multiple regression.
In contrast to multiple regression, the _________________ method is noncompensatory, which means that a minimum score on each predictor must be obtained before a job applicant will be considered for selection. This technique can be used in conjunction with multiple regression by first selecting only those people who score above the minimum score on all predictors and then using the multiple regression equation to predict each selected person’s criterion score.
Multiple cutoff.
