Assessment Flashcards
(259 cards)
0
Q
What is Spearman’s “g” factor?
A
General intelligence and he proposes that intelligence tests should easier intelligence without becoming clouded by specific abilities.
1
Q
What is the Raven’s Progressive Matricies?
A
Series of abstract patterns with one piece missing - u pick out the missing piece using a multiple choice format. It’s one of the best non verbal tests of intelligence. It is also a novel task.
2
Q
A criterion based score describes what?
A
How a person did in relation to some external criterion. Like a percentage tells us exactly how the person did on the test or how much the criterion was mastered.
3
Q
What is face validity?
A
Not technical validity bit what the test seems to superficially measure. Whether it “looks” valid to the untrained eye.
4
Q
What does a norm based score tell us?
A
Tells us how they did relative to other test takers and say nothing about how much they mastered the material. Like percentiles, standard scores, an. iQ scores are all norm based scores standards scores, Z scores, T scores).
5
Q
What is construct validity?
A
Looks at how well a test measures an underlying construct using methods such as factor analysis, or the multi trait, multi method matrix.
6
Q
What is criterion related validity?
A
Looks at how well a test predicts criterion outcome by correlating scores on the predictor test with a measure of outcome.
7
Q
Who is more likely to commit suicide middle to high SES or low SES?
A
Middle to high
8
Q
What is frame of reference training used for?
A
Frame of reference training is used to improve the accuracy of performance ratings. Frame of reference training provides raters with common performance standards to help raters become clear on what constitutes good and bad behavior. While such training may in fact reduce Raytee-based sources of error, such as personal biases and the halo effect; it made to decrease the effect of biases that lead to unfair discrimination, but the goal for frame of reference training is broader than the amount then the elimination of anyone specific source of error.
9
Q
The problem with the WISC-IV for assessing gifted children is what regarding to it’s ceiling?
A
It has a low ceiling with the maximum possible IQ score of about 150 which is three standard deviations above the mean that’s limiting its effectiveness in assessing giftedness and children.
10
Q
The problem with the WISC-IV for assessing mental retardation in children is what regarding to it’s floor?
A
It has a high floor or a minimum possible scores about 50 or three standard deviations below the mean. As a result this test cannot provide an accurate assessment of the level of mental retardation and someone with this disorder.
11
Q
What would be a better test for giftedness or mental retardation then why?
A
The Stanford-Binet
Because it has a high ceiling of 180 and a much lower floor then the WISC
12
Q
What are the validity scales on the MMPI-2?
A
L F K
13
Q
What is the L scale on the MMPI-2?
A
The L scale is the lie scale. Elevation on scale L indicates a naïve attempt to look good.
14
Q
What does an elevation on the K scale suggest?
A
The K scale is the guardedness scale. High scores suggest that the person is making a more sophisticated attempt to present himself in a positive light or fake good. Alone score on K is suggestive of someone who is excessively open, has poor ego strength, and tends to openly reveal his or her negative aspects.
15
Q
On the validity scales on the MMPI two what does a V-shaped pattern usually’s say?
A
Faking good
16
Q
What do elevations on the F scale reflect?
A
They reflect pathology or an attempt to present in a negative light.
17
Q
What would an inverted V shaped pattern on the MMPI-2 validity scales represent?
A
Someone trying to present in a negative light like claimant in a malpractice suit or patient with schizophrenia
18
Q
When a behavior is not discrete and has no clear beginning or end because in such instances is not possible to measure the number of times that a child is on task for example what kind of recording would we use?
A
Interval recording- The time period of observation is divided into smaller interval intervals, for example an hours divided into 12 five-minute intervals.
19
Q
During interval sampling what is called when the observer notes what is the behavior was present at the moment the interval ends?
A
Momentary time sampling
20
Q
During interval sampling what is it called when the observer notes whether the behavior was present for the entire duration of the interval?
A
Whole interval sampling
21
Q
What is the event recording and when is it used?
A
Event recording, the observer simply record the number of times the target behavior occurs for example how many times the child made his bed. It is used is also called frequency recording any use for discreet, easily measured behaviors
22
Q
What is content sampling as a source if error?
A
Error due to content sampling occurs when a test, by chance, has items that tap into a testtakers knowledgebase, or item that don’t happen to a testtakers knowledge.
Content sampling is a source of error when assessing the reliability of a test, in particular, alternate forms reliability and split half reliability.
23
Q
What is purposive sampling?
A
Is sampling procedure for selecting subjects. It involves selecting a particular sample because it is believed to be representative of the population. For example test marketing a new product in Los Angeles because it is believed that how Los Angeles people view the product will be similar to how people and the rest of the country will be at the product.
24
What disorder has the highest rate of comorbidity with Tourette's syndrome?
ADHD
25
The lifetime prevalence ratio of depression among women and men is what?
Two to one
26
What is diagnostic overshadowing?
Diagnostic overshadowing is a bias that negatively affects clinicians diagnostic accuracy when diagnosing persons with mental retardation and other developmental disabilities. In essence, the intellectual deficits are such a notable feature and persons with developmental disabilities that any accompanying more minor psychiatric disturbance tends to be overshadowed and therefore not diagnosed.
27
What is another term for item response theory?
Latent trait model
28
What are latent trait models used to establish?
They are used to establish a uniform scale of measurement that can be applied to individuals of varying ability and to test content of varying difficulty.
29
What is the premise of classical test theory?
Total variability in testtakers scores can be explained by combination of the tests reliability and error variability.
30
What is the prevalence of OCD in men versus women?
Equally common
31
What is the prevalence of OCD in girls versus boys?
It is much more common in boys and girls
32
At what age is the boys generally develop OCD?
Between six and 15
33
At what age do girls usually develop OCD?
Between the ages of 20 and 29.
34
What is it called when an employer's rates and employee on one dimension influences ratings on other dimensions of the employees performance weather in a positive or negative direction?
The halo effect
35
What is it called when ratings are based on the employee's most recent performance rather than on performance during the entire rating.?
The recency effect
36
What is it called when employers ratings of an applicant is influenced by prior applicants?
The contrast effect
37
What is it called when a rater uniformly evaluates candidates favorably?
A leniency bias
38
Autistic disorder is characterized by what three things?
Impairment in social interactions
Impairment in communication
Restricted repertoire of behavior
39
How common is autistic disorder in boys and girls?
4 to 5 times more common in males
40
What is the age of onset for autism and is prognosis best with late or early onset?
Before age 3
Best with late onset
41
What is a functional analysis of behavior?
Functional analysis of behavior involves looking at the behavior, its antecedents and consequences, as well as the contingencies and the reinforcers that served to maintain the behavior.
42
It researchers enlisted to design it early detection program for schizophrenia is fine example of primary secondary or tertiary prevention?
Secondary
43
What is the most established test children's intelligence?
WISC IV
44
What is the most empirically validated theory Of human intelligence?
catell-horn-caroll theory
45
catell-horn-caroll theory is the foundation of popular test of aptitude and intelligence?
Woodcock Johnson III
46
What is a three stratum model, with general intelligence at the top level, broad cognitive abilities in the middle, and narrow cognitive abilities at the bottom?
catell-horn-caroll theory
47
What do we know about bipolar disorder with psychotic features related to both the mood and psychotic features?
When the mood symptoms we met the person does not experience psychotic symptoms.
48
What do we know about the mood and psychotic symptoms with schizoaffective disorder?
Mood and psychotic symptoms are concurrent except for a two-week period when there are psychotic symptoms without mood symptoms.
49
What are we testing when we are measuring subject on the same test at two point in time?
Test retest reliability
50
What are we call when we are measuring subjects onto similar versions of the test at two different points in time?
Alternate forms reliability
51
What can we do to specifically increase test reliability?
More items on a test
Homogeneity of the items
An unrestricted range of scores that results from a more heterogeneous sample
Difficulty of guessing
52
The Kappa coefficient would be used to measure what?
Interrater reliability
53
What are other measures of interrater reliability?
Percent agreement between raters
Pearson r between scores given by the raters
yules Y
54
Test retest reliability is typically expressed by the coefficient of what?
Stability
55
Parallel forms of reliability is typically expressed by the coefficient of what?
Equivalence
56
kuder-Richardson and Cronbach's alpha are measures of what?
Internal consistency reliability
57
What percentage of individuals diagnosed with schizophrenia will experience auditory hallucinations?
75%
58
Olfactory hallucinations are more often indicative of what?
And organic brain disorder such as a tumor
59
Someone diagnosed with intermittent explosive disorder, do they have remorse after their behavior?
Yes
60
Children with autism show relative strength on what test? Compared to their peers
The embedded figures tests or the EFT. The EFT measures cognitive functioning by having the examinee try to locate simple geometrical shapes that are hidden in more complex diagrams.
61
What is the TONI-3?
The test of nonverbal intelligence measures intelligence, aptitude, abstract reasoning, and problem-solving completely free of the use of language.
62
What is the TONI-3 Best used with?
It is particularly well-suited for individuals were known or believed to have disorders of communication are thinking that may result from mental retardation, deafness, development of developmental disabilities, autism, cerebral palsy, stroke, disease, head injury, or other neurological impairment.
63
What is the ravens progressive matrices and who is the best used with?
Generally thought to be one of the best nonverbal test of intelligence. It is also stated for individuals with severe motor impairments and speech limitations. Spearman himself considered Raven's progressive matrices to be the best nonverbal measure of the G factor.
64
What is an example of a false alarm?
A false alarm is a false positive or it is a false alarm if you think someone has HIV but he doesn't
65
What is the definition of "hit"?
A means true positive
66
What is a miss?
A Miss means false-negative or it is a miss if you think someone is HIV negative when she's actually HIV-positive
67
What is the correct rejection?
A correct rejection means true negative in this example the subject has had nine true negatives and one false positive or 90% correct rejections and 10% false alarms.
68
What is a false negative?
For example attest that incorrectly classifies those with less severe eating disorders as not having the disorder would be a false negative
69
What can psychologists do to increase the sensitivity of a test? For example if you're concerned with having too many false negatives?
You lower the predictor cut off. If the test is not sensitive, it may incorrectly classify those with less severe of the said disorder as not having the disorder and in order to remedy this, the psychologist can lower the predictor cut off.
70
Can the criterion cut off of the test be changed?
No
71
What is incremental validity?
It is the proportion of improvement in the success rate achieved by adding a predictor test over and above the starting base rate.
72
What is the base rate?
The base rate is the rate of selecting successful employees without a predictor test.
73
What is the selection ratio?
The selection ratio is the ratio of the number of openings to the number of applicants for example one opening for every 10 applicants is 1:10 or .1.
74
What are the Taylor Russell tables?
According to Taylor Russell tables, incremental validity is optimized when the base rate is moderate about .5 and the selection rate is low close to .1. In other words a good predictor test will make the biggest difference when there has been moderate success in choosing successful employees without the predictive text, and there is a large pool of applicants with a relatively few openings.
75
What and what are alternatives to classical test theory?
Latent trait model and item response theory
76
What is item response theory or latent trAit model?
It is assumed that item performance is related to the amount of the respondents late tree like statistics ability. Later trait models are used to establish a uniform scale of measurement that can be applied to individual the varying ability and to test content of varying difficulty.
77
What is classical test theory?
Total variability in testtakers scores can be explained by combination of the test reliability and error variability.
78
Children with autism show relative strength on the following test?
Embedded figures test
79
What is an embedded figures test or EFT?
The EFT measures cognitive functioning by having the examinee try to locate simple geometrical shapes that are hidden in more complex diagrams.
80
Spearman himself consider the following test to be the best nonverbal measure of the G factor.
Raven's progressive matrices
81
This occurs when the criterion is subjectively scored, and the reader has knowledge of the employees predictor scores?
Criterion contamination
82
Criterion contamination results in a spuriously high blank validity coefficient?
Hi criterion related validity coefficient
83
What is something that could reduce the recency effect?
Quarterly appraisals or evaluations
84
This is a tendency bias that occurs when a rater tends to write all employees as about average?
The central tendency bias
85
On the MMPI – two, which validity scale also serves as a moderator variable? And what does the scale adjust for?
The K scale
| Defensiveness
86
The following scales on the MMPI – to measure response inconsistency or random responding?
Vrin
| TRIN
87
The standard errors of the mean, the standard errors of measurement, and standard error of the estimate express errors in terms of what?
Standard deviation units
88
Blank applies to the standard error of the mean only?
Sampling error
89
This source of error happens or is taken into account in the standard error of measurement only?
The testing situation is a source of error
90
When validity is high what happens to error in prediction?
When validities hi there should be little error in prediction and when validity is low, there should be a lot of Error in prediction
91
What kind of relationship is the standard error of estimate have with the standard deviation?
The standard error of estimate has a direct relationship with the standard deviation, the larger the standard deviation, the larger the standard error.
92
What is a forced choice or a forced response and what does it help control?
A forced response format in which the rater is forced to choose between two equally desirable or undesirable attributes. And it helps to reduce the halos
93
What is BARS and what might it help reduce?
Behaviorally anchored rating scales
Objective rating scales for work performance
The halo effect
94
What three things are known to help with the halo effect?
Training the Raters
Utilizing forced choice or a forced response format
Objective rating methods such as BARS
95
What is utilizing relative methods?
Relative methods involve comparing employees with one another and does not control for Halo effects
96
What is the range for reliability coefficients?
What is the range of the validity coefficient?
What is the range of the standard error of measurement?
What is the range of the standard error of estimate?
0. 0 - 1.0 Reliability
- 1.0 to 1.0 validity
Standard error of measurement = 0-SDx (of the test)
Standard error of the estimate = 0- SDy (criterion)
97
The following reflects the degree of relationship between pairs of scores from the same group of people who were are administered an identical test at two points in time?
The test – retest reliability coefficient
98
The following indicates the strength of the relationship between a predictor test and a criterion outcomes such as how well SAT scores predict college GPA?
Criterion related validity coefficient
99
The following measures the degree to which a test is actually measuring the construct for the trade it is attempting to measure for example aggression?
Construct validity
100
The two following forms of validity are necessary to establish construct validity?
Convergent and divergent validity
101
What is diuresis?
Excessive urination
102
Blank is the rate of successful hiring without using a test.
Base rate
103
A moderate base rate optimizes what kind of validity?
Incremental
104
Blank is the ratio of number of openings to number of applicants?
Selection ratio
105
A low selection ratio optimizes what kind of validity
Incremental
106
Blank kind of validity of the test is the correlation between scores on the test and scores on some outcome measure of performance and productivity
Criterion related validity
107
The higher the criterion related validity of the test the higher the blank validity
Incremental
108
Good Taylor – Russell tables are used to evaluate ----- validity, the benefit of using a test for improving selection decisions. The key variables that tables take into account include base rate, selection ratio, and what else?
Criterion related validity
| Incremental validity
109
Disorders that are equally common in males and females are what? There are three
Schizophrenia, bipolar one, and OCD
110
How much more common is autistic disorder in boys than girls?
4 to 5 times more common in males
111
What is the prevalence ratio of ADHD and boys and girls
6 to 9 times more common in boys
112
What is the concordance rate for identical twins for bipolar one disorder?
75%
113
By increasing the length of the test which will be affected reliability or validity?
Both
114
What can you tell me about validity and reliability when we increase the length of a test?
Increasing test length will have a direct impact on reliability since it is one of the key factors that affect reliability. Since reliability, in turn, puts a ceiling on validity increasing test length will also affect the validity. However the effect on validity will be less direct overall, reliability would be more effective than validity
115
The degree of correlation between the predictor and the criterion is called what?
Criterion related validity
116
The following is the extent to which the actual criterion for example church attendance truly measures the conceptual criterion or what we are measuring in this case morality?
Criterion relevance
117
What is the relationship between criterion deficiency and criterion relevance?
The greater the criterion deficiency the less criterion relevance
118
What is the age of onset for autistic disorder?
Three years old
119
What is the age onset for asperger's ?
There is no specified age
120
The requirement of blank years of normal development is a marker for childhood disintegrated disorder?
2
121
What is a type a personality
Stressed, hard-driving, inpatient, competitive
122
For type a personalities what is the most predictive quality that leads to the cardiovascular disease?
Hostility and conflicts about expressing anger
123
Diseases that are X – linked are more common in what gender?
Men
124
Early centuries interested in how well IQ predicts success in high school gPA. She selects a random sample of eighth-graders. The standard error of measurement is what?
The standard error of measurement is the average amount of error in each person's IQ score as measured as measured by the IQ test
125
What is the average amount of error in prediction?
The standard error of the estimate
126
What is the average amount of error in the groups mean, in relation to the population mean?
The standard error of the mean
127
What is another word for the average amount of spread of IQ scores?
Standard deviation
128
What is empirical criterion keying?
Used in the original development of the MMPI? Items are chosen based on their ability to discriminate group membership. In other words, a specific item on the MMPI was only kept on the schizophrenia scale if people without schizophrenia and people with schizophrenia answered it differently.
129
What is an ipsative measure?
These measures yield only information on an individual, without any information about how the individual compares to others. For example, and a positive measure might show that Mr. Smith likes gardening more than cooking, but doesn't tell us whether he likes gardening more or less than the average person does.
130
What is another word for item response theory?
Latent trait theory
131
What is item response theory or otherwise known as latent response theory?
It is used to calculate to what extent the specific item on a test correlates with an underlying construct. Put differently, item response theory looks at a subjects performance on a test item as representing the degree to which the subject has a latent trait. For example, correctly answering it difficult statistics question would indicate subject is high in the latent trait of statistics ability. It can be used, therefore, to compare subject performance on two measures that have different types or numbers of items or our score differently. Item response theory is used to develop individually tailored adaptive test in which an answer to one question in a domain area determines whether another question in that area will be asked such tests and up having the fewest number of items necessary to assess the subjects performance.
132
When operant conditioning is measuring operant strength what else is it measuring?
Response rate or the frequency with which a behavior is emitted
133
What age range our night terrors typically occurring?
3 - 12 years old
134
What is the peak age of onset from night terrors?
3 1/2
135
What percentage of children experience night terrors?
1 - 6 %
136
When do night terrors typically remit?
Adolescents
137
Biographical data shows good blank validity
Criterion related validity
138
What kind of validity is this: finding a correlation between current motivation and current work performance?
Concurrent validity
139
What kind of validity is this: a new intelligent test correlating highly with theWAIS IV?
Convergent validity
140
What kind of validity measures and underline hypothetical construct a trait?
Construct validity
141
Criterion related validity may also be called what kind of other validity?
Predictive validity
142
Blank is defined as the amount of consistency, repeatability, and dependability in scores obtained on a given test.
Reliability
143
What is another word for classical test theory?
The true score model
144
What does classical test. Or the true score model say? What is the formula about total variability in testtakers scores?
Total variability in scores equals true score variability plus error variability
145
What is true score variability?
The variability in scores due to real differences in ability or knowledge in the test takers
146
What is Error variability?
Variability in scores that is caused by chance or random factors
147
Reliability is the proportion of blank?
True score variability
148
What is the minimum acceptable score for reliability?
.80
149
What are three common sources of error in tests?
1. Content sampling error
2. Time sampling
3. Test heterogeneity
150
What is time sampling?
Times sampling error occurs when a test is given it to different points in time, and the scores on each administration are different because of factors related to the passage of time e.g. forgetting overtime.
151
What is test heterogeneity?
It is error due to the test heterogeneity occurs when a test test heterogeneous items tapping more than one domain
152
What four factors affect reliability?
1. Number of items
2. Homogeneity of items
3. Range of scores
4. Ability to guess
153
How is reliability affected by number of items on a test
Reliability is increased when the number of items is increased, and it is decreased when the number of items is reduced
154
How does the homogeneity of items affect reliability?
Homogeneity of items refers to items tapping similar content areas. All things being equal, the more homogeneous the items are the greater the reliability.
155
How does range of scores affect reliability?
An unrestricted range, or a full spread of scores, maximizes reliability. A restricted range has the reverse effect and reduces the reliability coefficient. The range of scores obtained is related to the heterogeneity of the the more heterogeneous the subjects are on the dimension being measured the greater the range of scores.
156
How does the ability to guess affect reliability?
The easier it is to guess for example with true false test the lower reliability is. This is because reliability indicates to score variability or how much of the scores based on with the test-taker really knows. If it's easy to guess one's score will be less dependent on what one knows, and more due to chance factors.
157
Test retest reliability is expressed as a coefficient of blank? The major source of error for test retest reliability is blank?
The coefficient of stability
Time sampling
158
Parallel forms or alternate forms or equivalent forms of reliability are expressed as the coefficient of blank? There are two forms of error in parallel alternate equivalent forms reliability what are those?
Coefficient of equivalents
Time and content sampling
159
Name for estimates of reliability?
1. Test retest reliability
2. Parallel forms reliability
3. Internal consistency reliability
4. Interrater reliability
160
What is internal consistency reliability?
It looks at the consistency of the scores within the test
161
What are the two different types of internal consistency reliability?
1. Split – half reliability
| 2. Kuder – Richardson and Cronbach's coefficient alpha
162
What is split half reliability and what bigger category of reliability it is it part of?
1. Split half reliability falls under internal consistency reliability
2. Split have reliability is calculated by splitting the testing half and then correlating the scores obtained that each half by each person. When the test is split in half, the correlation is based on half the number of items.
163
The split half reliability overestimate or underestimate the true reliability of a test?
Underestimates
164
That Spearman – Brown prophecy formula falls under what type of reliability and what does it tell us?
Split half reliability which falls under internal consistency reliability
It tells us how much more reliable the test would be if it were longer
165
What is the source of error for split half reliability?
Item or content sampling
166
First speeded tests what types of reliability would be appropriate and what types of reliability would not be appropriate?
Split half would be inappropriate
Alternate forms is best next best is test retest reliability
167
What is a power test?
How are tests have items that are of varying difficulty level, and subject of provided sufficient time to complete them all. Scores are generally expressed in terms of percentage correct. The E triple P is an example of a power test
168
What is an example of the standard error of measurement think of the WAIS-IV?
Plus or minus the error of measurement is added to the IQ score that leads you to the confidence intervals
169
What is validity?
Validity is about accuracy
170
Name three types of validity (range of score)
Name four types of reliability (range of score)
1. Content validity
2. Criterion related validity
3. Construct validity
- 1.0 - 1.0
1. Test retest
2. Alternate / parallel forms
3. Internal consistency
4. Inter rater
0. 0 - 1.0
171
What are the differences between the three types of validity? (Content, criterion related, construct)
1. Content- tests but it is supposed to test so a test on statistics
2. Criterion related validity how adequately a predictor score can be used to predict a criterion score like how accurate is a score on the SAT to graduate school GPA
3. Construct validity is how adequately it measures the hypothetical construct of fear or aggression
172
Name the three types of validity and the two that are mutually exclusive
Content criteria three and related and construct. Content and construct are mutually exclusive
173
What is convergent validity and what category does it fall under
Convergent validity is correlating the new test two other available measures of the same test so the test with teacher ratings of aggression they should have moderately high correlations and it falls under construct validity
174
What is the divergent validity and what bigger category does a fall under?
It falls under construct validity. Discriminate validity is correlating the new test with scores that permit measure a different construct this correlation should be low
175
What is an acceptable number for criterion related validity
.20
176
Criterion related validity has to validities what are those
1. Concurrent validity
| 2. Predictive validity
177
What is concurrent validity and what larger category doesn't fall under?
Concurrent validity falls under criterion related validity. It measures the Preidt the predictor in the criterion at about the same time like taking the PE triple P and the each of a peek within a few days
178
What is predictive validity and what bigger category doesn't Fahlander
Predictive validity falls under criterion related validity. This is where the predictor in the criterion are measured but with a delay between each one for example you take the SAT and then four years later you get the GPA and see the correlation
179
Does the standard error of the measurement have to do with reliability or validity? Does the standard error of the estimate have to do with reliability or validity?
Measurement goes with reliability and estimate goes with validity
180
What is the standard error of the estimate and is it related to reliability or validity?
The lady. The standard error of the estimate predicts how well the predictor predicts the criterion and the ranges zero to the standard deviation of the criteria
181
What are the three applications of criterion related validity
1. Expectancy tables
2. Taylor Russell tables
3. Decision-making theory
182
What are expectancy tables and what kind of validity do they apply to
Criterion related validity expectancy tables with the probability that a person's criterion score will fall in a specified range based on the range in which the persons predictor score fell
183
Taylor Russell tables are applications of what kind of validity
Criterion related
184
Decision-making theory is an application of what kind of validity
Criterion related validity
185
Under decision-making theory which falls under Blank validity what can we say about applicant them fall above the predictor cut off are below the predictor cut?
Criterion related validity
Those that fall above the predictor cut off a classified as past as positive or passing and successful while those who score below the predictor cut off I classified as negative or failing and unsuccessful
186
In creating a predictor test there are five steps that are typically taken in order to develop it
1. Conceptualization
2. Test construction
3. Test to try out
4. Item analysis
5. Test revision
187
What is conceptualization and what bigger category doesn't Fahlander
The development of a predictor test
Conceptualization is where the test developer decides on the test subjective, administration, and overall format for example this will be a 20 item that test designed to predict sales potential
188
What is test construction and what category does it fall under
The development of a predictor test
Test construction is whether developer decides an item format is it multiple-choice picture and false and writes the items
189
What is test try out and what larger category does this fall under
Development of a predictor test
This is where the developer tries out all the items on the available sample
190
What is item analysis and what bigger category does it fall under
Item analysis is where each item is analyzed in a variety of ways with the goal of deciding which items are best and should be kept
Falls under the development of predictor test
191
Item analysis which falls under what bigger category has underneath it for subcategories please list
Item analysis falls under the video category of development of a predictor test
1. Item difficulty
2. Item discrimination
3. Item validity
4. Item characteristic curve
192
What is item difficulty and what two categories does it fall under
1. Development of a predictor test
2. Criterion related validity
Item difficulty symbolized by AP, can range in value from .01 2.99. Game difficulty level is the proportion of people that got the item right for example, AP of point one event only 10% of people got it right and that it was a difficult item in general book is desirable for items to have an average difficulty of .5 with a range of .3 .8
193
What is item discrimination what two categories does it fall under
1. Development of a predictor test
2. Criterion related validity
Item discrimination looks at how well a particular item discriminates between high scorers and low scorers
194
What is item validity and what two categories doesn't fall under
1. Development of a predictor test
2. Criterion related validity
Item validity is simply the correlation between item score and criterion score the higher the correlation the more valid the item is
195
What is item characteristic curve and what to category doesn't fall under
1. Development of a predictor test
2. Criterion related validity
I am characteristic curve is the plot of the relationship between item performance and total score. Item difficulty level is defined as the 50% threshold or the score at which respondents have a 50-50 chance of getting them right
196
The mathematical approach involved in plotting and analyzing item correct characteristic curves is called blank or blank
Item response theory or latent trait theory
197
What is test revision and what two categories doesn't fall under
Development of a predictor test and criterion related validity
Test revision is the final step after item analysis, subtest of the test items is kept and the rest of the items are thrown out
198
What is cross validation and what's three categories does it fall under? What is it and what does it lead to?
1. Test revision under
2. Constructing a predictor test under
3. Criterion related validity
Cross validation and is administered to a new sample in order to test out its validity and another group of people. Cost validation always results in shrinkage of the criterion related validity coefficient. Shrinkage occurs because of sample differences is the items were selected because they were the best for that specific original sample, I cannot possibly be as good for a different sample of people.
199
What four factors affect criterion related validity
1. Range of scores
2. Reliability of the predictor
3. Reliability of the predictor and criterion
4. Criterion contamination
200
What do we know about range of scores and what kind of validity does it affect
The range of scores affects criterion related validity. Validity is maximized by an unrestricted range of scores I'm both the predictor and the criterion. Any restriction in range will reduce criterion related validity. The range of scores is obtained related to the heterogeneity of the subjects. the more heterogeneous the subjects are in terms of the factor being assessed, the greater the range of scores will be
201
The reliability of the predictor affects what kind of validity and what is it
It affects criterion related validity. Test cannot be valid unless there is some degree of reliability. A reliable test, however, does not imply that there will be any validity whatsoever. In other words reliability sets of feeling on validity. Validity can actually be higher than reliability. This concept is sometimes expressed in the following terms: attests correlation with another test which is validity can be higher than attests correlation with itself which is reliability.
202
What do we know about the relationship between validity and reliability?
Reliability is used to determine the feeling for validity but validity can actually be higher than reliability.
203
A tests correlation with another test is an example of blank and it can be higher than a tests correlation with itself which is an example of blank
Validity and reliability
204
Reliability of the predictor in the criterion affects what kind of validity? And what is
Neither the predictor nor the criterion is perfectly reliable. This imperfect reliability creates measurement error when the predictor and criterion our quarterly. The correlation is less than what it would have been if the predictor and criterion had been perfectly reliable, or put differently, validity is attenuated by the lack of reliability.
205
What is the correction for attenuation and what validity is it associated with
Criterion related
The correction for attenuation formula calculates how much higher validity would be if the predictor and criterion were both perfectly reliable
206
What is the multi trade, multi method method matrix and what kind of validity is it associated with
Construct validity
It is a table with information about both convergent and divergent validity both of which are necessary for construct validity
207
What is the difference between an objective and subjective test?
Objective test: does not rely on a rater's judgment and has a scoring key (MMPI, EPPP)
Subjective test: involve some element of the rater's judgement like the TAT and Roschach
208
What is the difference between a normative score and an ipsative score? What kind of tests usually yield ipsative scores?
a normative score (t score or pecentile rank) tells us someone performed relative to others
an ipsative score provides us information on relative strengths and weaknesses of the person only does not compare it to others.
Vocational preference tests (Strong Campbell).
209
What is empirical criterion keying?
A process for selecting items to use in a test. The items are keyed to an external criterion. They are intended to differentiate between groups who have a trait and those who do not. EG MMPI, scale 8, only items that were found to differentiate between normals and those with schizophrenia were included in the test.
210
Over the years, psychologists have basically been of two camps related to the meaning of intelligence: those that agree that it is a ______, and those who believe there are _______.
single general ability
| several distinct kinds of intelligence
211
Who are the six main theorists of intelligence?
1. Spearman
2. Thurstone
3. Catell
4. Catell-Horn-Carroll
5. Gardner
6. Sternberg
212
What is Spearman's 1927 theory?
intelligence is a single factor, mainly the "g" factor
| the most widely tests of intelligence use the "g" factor (Wechsler and Stanford-Binet)
213
What is Thurstone's 1938 theory?
There are seven distinct primary mental abilities:
1. verbal comprehension
2. word fluency
3. numerical fluency
4. spatial visualization
5. associative memory
6. perceptual speed
7. reasoning
214
What is Cattell's theory?
Cattell said that the "g" factor does exist with two subtypes, namely fluid intelligence and crystallized intelligence.
215
What is fluid versus crystallized intelligence?
Fluid - partially determined by biological and genetic factors, is the capacity to acquire new knowledge, and solve new problems
Crystallized - is more about culture and education, and is knowledge and learning gained over one's lifetime through an interaction between fluid intelligence and environment
216
What is Cattell-Horn-Carroll's theory?
The most empirically validated theory of human intelligence.
Three levels:
III. "g" or general intelligence
II. 10 broad cognitive abilities such as fluid reasoning, short term memory, visual processing, reading and writing
I. 70 narrow cognitive abilities
217
What is Gardner's theory of intelligence? (1986, 1996)
He has 8 areas and says people differ in their profile of intelligence and have relative strengths and weaknesses.
1. linguistic
2. logical-mathematical
3. spatial
4. musical
5. bodily-kinesthetic
6. interpersonal
7. intrapersonal
8. naturalistic
218
What is Sternberg's triarchic theory of intelligence? 1985
Focuses on process rather than product - the process by which you used to arrive at answers to problems.
1. internal components (those we use to acquire, store, perceive, and remember)
2. the capacity to adapt to environmental changes
3. the ability to apply past experience to current novel problems
219
The WAIS-IV is appropriate for person from ___ to ___ years old. It has ___ core subtests and ____ supplemental subtests. It allows for the calculation of a _____, four _______, and an optional ______. IQ scores have a mean of ______, and a standard deviation of _____, subtests have a mean of _____ and a standard deviation of ____.
```
16 - 90
10; and 5
FSIQ and four primary index scores, GAI
100, 15
10, 3
```
220
The VCI or ______ includes subtests ____, ____, and ____ with ____ with supplemental.
verbal comprehension index
similarities, information, vocabulary
comprehension
221
The PRI or ______ includes subtests ____, ____, and ____ with ____ and _____ with supplemental.
perceptual reasoning index
block design, matrix reasoning, and visual puzzles
picture completion and figure weights
222
The WMI or ______ includes subtests ____, and ____ with ____ as supplemental.
working memory index
digit span and arithmetic
letter number sequencing
223
The PSI or ______ includes subtests ____, and ____ with ____ as supplemental.
processing speed index
coding and symbol search
cancellation
224
What is the GAI?
General Abilities Index is when you only use the VCI and PRI for a composite score to reduce the impact of the WMI and PSI.
225
Although the WAIS-IV is based on the Wechsler four factor model, may of the subtests can be interpreted along the lines of the _____.
CHC or Catell-Horn-Carroll model three strata model of intelligence.
226
The WISC-IV is for children aged ___ to ____. There are ____ core substests and ____ supplemental tests. The test was normed on many demographic variables such as ____(5). A ___ version is available. Allows for a full calculation of a ____, four ______, and an optional ____. The IQ score mean is ____, with a SD of ___, and subtest scores have a mean of ___ with a SD of ___.
```
6-16
10; 5
age, sex, parent education level, region, and race/ethnicity
Spanish
FSIQ and primary index scores, GAI
100; 15
10; 3
```
227
On the WISC-IV the VCI or ______ includes subtests ____, ____, and ____ with ____ with supplemental.
verbal comprehension index
similarities, vocabulary and comprehension
supplemental: information and word reasoning
228
On the WISC-IV the PRI or ______ includes subtests ____(3), ____, and ____ supplemental.
perceptual reasoning index
block design, picture, concepts, matrix reasoning
supp: picture completion
229
On the WISC-IV the WMI or ______ includes subtests ____, ____, and ____ with ____ with supplemental.
digit span and letter number sequencing
| supp: arithmetic
230
On the WISC-IV the PSI or ______ includes subtests ____, ____, and ____ with ____ with supplemental.
coding and symbol search
| cancellation supp
231
_____ abilities do NOT decrease with age, they remain intact and improve. _____ abilities peak in adolescence and decline thereafter in a steady and gradual manner.
Crystallized (VCI)
| Fluid (PRI)
232
_____ subtests tend to be more culturally loaded than the ____ subtests. And may therefore be inappropriate for those individuals of _____. The PRI would not be appropriate for those with ____.
culturally
a different cultural background or language
impaired motor functioning
233
In terms of psychological functioning, the performance subtests are more suceptible to effects of ____ and ____. And persons with a hx of ____ or _____ have a tendency for the PRI to be lower than the VCI.
depression and anxiety
| substance abuse, schizophrenia
234
On the WAIS and WISC the BEST overall estimate of the VCI is the ____ and the BEST overall estimate of the PRI is the ____
vocabulary, block design
235
What are the two best "hold tests" of the VCI and what does that show?
A "hold test" is one that holds steady and does not usually decline after brain damage or injury and are good indicators of pre-moribid intellectual functioning.
vocabulary and information
236
Scores on the ___ and ___ decline more than age with ___ declining more significantly. Scores on ___ do not tend to decline and ___ decline slightly.
PSI and PRI
PSI more
VCI no decline
WMI decline slightly
237
____% of the population have IQs between ____ and ___.
50%; 90 - 110
238
To be diagnosed with mental retardation, IQ must be ___ or below. or ____ or more SD below the mean. A person must also demonstrate significant deficits of ____ in at least ___ areas such as ___, ___, ____). A test used to assess is the ____.
```
70; 2 SD
adaptive functioning deficits
TWO areas at least
communication, self care, social/interpersonal skills
Vineland Test of Adaptive Fx
```
239
The WISC-IV has a floor of ____ and a ceiling of ____. Whereas the Standford Binet 5 has a floor in the ____ and a ceiling of ____ thus making it the best choice in a test testing for ____ or _____.
40 and 160
teens and 180
MR or giftedness
240
The ___ is considered to be one of the best non verbal tests of intelligence and Speaman considered it the best non verbal measure of the "g" factor. The test consists of ___. It is appropriate for ___ and ____.
Raven's Progressive Matricies Test
a series of abstract patterns with one piece missing / Multiple choice
children and adults.
241
A high score on the L scale indicates what?
a naive attempt to present himself favorably - should be in the normal range or 50.
242
A high score on the F scale indicates what ?
high scores = psychotic processes or a tremendous degree of distress, or an attempt to appear in a negative light or a cry for help.
Scores => 100 would invalidate the profile and may be malingering
"fake bad scale"
243
A high score on the K scale indicates what ? What about a low K score?
"fake good scale"
guardedess scale - a more sophisticated attempt to present in a positive light
A low score is someone is excessively open, has poor ego strength and tends to openly reveal his/her negative aspects.
244
The _____ is used to adjust other clinical scales. the higher the person's score on ____, the more points are added to other scales.
K correction
| K
245
What are the 10 clinical scales on the MMPI-2?
1. hypochrondriases
2. depression
3. hysteria
4. psychopathic deviate
5. masculine/feminine
6. paranoia
7. pyschasthenia
8. schizophrenia
9. hypomania
0. social introversion
246
If a man scores high on on scale 5 or low, what does it mean? Same question for women.
Men high: have aesthetic interests and express warmth
Men low: more masculine interests
Women high: endorse male interests
Women low: passive and yielding
247
```
What are the following supplementary scales?
MAC-R, APS, AAS?
PK, PS
MDS
O-H
A
R
Es
Do
Re
```
```
MAC-R, APS, AAS = substance abuse
PK, PS = ptsd
MDS = marital distress
O-H= over controlled hostility
A = anxiety
R = repression
Es = ego strength
Do= dominance
Re = social responsibility
```
248
Is the MMPI-2RF a replacement or an alternative to the MMPI-2?
alternative
249
The MMPI-RF has ---- questions and ___ validity scales, ___ high order and restructured clinical scales, ____ somatic/cognitive and internalizing scales, __ externalizing, interpersonal, and interest scales, and __ personality psychopathology scales, .
```
338
8
12
14 somatic/cog
11 externalizing
5 psychopathology
```
250
The MCMI-III has --- questions. And answers correspond closely to ----. This test should not be used with a ____ population bc ____.
175
DSM-IV axis I and II disorders.
non clinical bc it exaggerates pathology
251
The Rorschach has ___ ink blots.
10
252
```
Describe the following scoring dimenstions on the Rorschach.
content
location
form quality
developmental quality
```
content - clothing, science, a whole human
location - W, D, Dd or S (white space)
form quality - accuracy to wha the blot representes
developmental quality - evaluating each answer wrt its response in terms of degree of integration
253
What is the R-PAS?
Rorschach Performance Assessment System
254
The R-PAS is a significant ____ of the _____. It's ____ oriented approach is designed to decrease _____ and alight the test with ____ and simplify ___ and ____ of data.
```
reformulation of the Roschach
internationally
variability between examiners
evidence base
simplify procedures and presentation of data
```
255
Neuropsychological tests measure : 5 things
perceptual, motor, verbal, memory and cognitive
256
What do the following neuropsych tests measures?
Wechsler Memory Scale
Stroop Test
Bender Visual Motor Gestalt Test
W: memory (verbal and nonverbal)
Stroop: cognitive functioning (problem solving and cognitive flexiblity)
Bender (perceptual / motor abilities)
257
What two neuropsych batters examine a patient's neuropsych fx?
Halstead Reiten
| Luria Nebraska
258
```
Achievement tests (2)
What would be indicative of a learning disorder?
```
WRAT4 and WIAT
| achievement test scores lower than IQ (2 SD)
