Assessment and Testing Flashcards
1
Q
Appraisal is?
A
the process of assessing or estimating attributes
2
Q
A test can be defined as a systematic method of measuring a sample of behavior. Test format refers to the manner in which test items are presented. The format of an essay test is considered what format?
A
subjective
3
Q
The NCE is what kind of test based on the specific scoring procedure?
A
objective
4
Q
A short answer test is what kind of test?
A
free-choice
5
Q
The NCE and the CPCE would be examples of what kind of test?
A
forced choice
6
Q
The _____ index indicates the percentage of individuals who answered each item correctly.
A
difficulty
7
Q
Short answer tests and projective measures utilize free response items. The NCE and CPCE uses forced choice or so-called ____ items.
A
recognition
8
Q
A true/false test has ____ recognition items.
A
dichotomous
9
Q
A test format could be normative or ipsative. In the normative format…
A
each item is independent of all other items
10
Q
What do ipsative measures compare?
A
traits within the same individual, not a person to other persons who took the instrument
11
Q
A client who takes a normative test…
A
can legitimately be compared to others who have taken the test
12
Q
In an ipsative measure, the person taking the test must compare items to one another. The result is that…
A
you can’t legitimately compare 2 or more people who have taken an ipsative test
13
Q
Tests are often classified as speed tests vs. power tests. A timed typing test used to hire secretaries would be…
A
a speed test
14
Q
A counseling test consists of 300 forced response items. The person taking the test can take as long as they want to answer the questions. This is most likely…
A
a power test
15
Q
T/F: In a power test, time is not an issue.
A
true
16
Q
An achievement test measures maximum performance or present level of skill. Tests of this nature are also called attainment tests, while a personality test or interest inventory measures…
A
typical performance
17
Q
What is an interest inventory?
A
popular with career counselors; focuses on what the client likes and dislikes
18
Q
In a spiral test…
A
the items get progressively more difficult
19
Q
In a cyclical test…
A
you have several sections which are spiral in nature
20
Q
A test battery is considered…
A
a horizontal test
21
Q
In a test battery…
A
several measures are used to produce results that could be more accurate than those derived from merely using a single source
22
Q
What does a horizontal test measure?
A
various factors during the same testing procedure
23
Q
In a counseling research study, 2 groups of subjects took a test with the same name. However, when they talked with each other, they discovered that the questions were different. The researcher assured both groups that they were given the same test. How is that possible?
A
The researcher gave parallel forms of the same test
24
Q
When a test has 2 versions or forms that are interchangeable, they’re called…
A
parallel forms or equivalent forms
25
The most critical factors in test selection are...
validity and reliability
26
Validity refers to...
whether the test measures what it says it measures
27
Reliability refers to...
how consistent a test measures an attribute
28
Which is more important, validity or reliability? Why?
validity because a test must measure what it claims to measure
29
There are ___ basic types of validity
5
30
What are the basic types of validity?
content, construct, concurrent, predictive, consequentual
31
Content validity is?
"rational or logical validity"; does the test examine or sample the behavior under scrutiny?
32
Construct validity is?
refers to a test's ability to measure a theoretical construct; refers to the extent that a test measures an abstract trait or psychological notion
33
Concurrent validity is?
deals with how well the test compares to other instruments that are intended for the same purpose
34
Predictive validity is?
"empirical validity"; reflects the test's ability to predict future behavior according to established criteria
35
Consequential validity is?
tries to find the social implications of using tests
36
A counselor peruses a testing catalog in search of a test which will repeatedly give consistent results. The counselor...
is interested in reliability
37
Which measure would yield the highest level of reliability?
a very accurate postage scale
38
Construct validity refers to the extent that a test measures an abstract trait or psychological notion. An example would be:
ego strength
39
Face validity refers to the extent that a test...
looks to measure the intended attribute
40
A job test which predicted future performance on a job very well would...
have high criterion/predictive validity
41
A new IQ test which yielded results nearly identical to other standardized measures would be said to have...
good concurrent validity
42
When a counselor tells a client that the GRE will predict their ability to handle graduate work, the counselor is referring to...
predictive validity
43
A reliable test is ___ valid.
not always
44
A valid test is ___ reliable.
always
45
One method of testing reliability is to give the same test to the same group of people 2 times and then correlate the scores. This is called:
test-retest reliability
46
One method of testing reliability is to give the same population alternate forms of the identical test. Each form will have the same psychometric/statistical properties as the original instrument. This is known as:
equivalent or alternate forms reliability
47
A counselor doing research decided to split a standardized test in half by using the even items as one test and the odd items as a second test and then correlating them. The counselor...
was testing reliability via the split-half correlation method
48
Which method of reliability testing would be useful with an essay test but not with a test of algebra problems?
inter-rater/inter-observer
49
A reliability coefficient of 1.00 indicates...
a perfect score which has no error
50
An excellent psychological or counseling test would have a reliability coefficient of...
.90
51
A researcher working with a personality test discovers that the test has a reliability coefficient of .70 which is somewhat typical. This indicates that...
70% of the score is accurate while 30% is inaccurate
52
A career counselor is using a test for job selection purposes. An acceptable reliability coefficient would be ___ or higher.
.80
53
The same test is given to the same group of people using the test-retest reliability method. The correlation between the first and second administration is .70. The true variance is...
49%
54
To demonstrate the variance of one factor accounted for by another...
you square the correlation
55
IQ means?
intelligence quotient
56
____ did research and concluded that intelligence was normally distributed like height or weight and that it was primarily genetic.
Galton
57
Francis Galton felt intelligence was...
a unitary faculty
58
J. P. Guilford isolated 120 factors which added up to intelligence. He is also remembered for his...
thoughts on convergent and divergent thinking
59
Convergent thinking occurs when...
divergent thoughts and ideas are combined into a singular concept
60
Divergent thinking is...
the ability to generate a novel idea
61
A counselor is told by his supervisor to measure the internal consistency reliability of a test but not to divide the test in halves. The counselor would need to use...
the Kuder-Richardson coefficients of equivalence
62
The first intelligence test was created by...
Alfred Binet and Theodore Simon
63
Today, the Stanford-Binet IQ test is...
a standardized measure
64
IQ (intelligence quotient) is expressed by...
MA/CA x100
65
The Binet stressed age-related tasks. Utilizing this method, a 9 y/o task would be one which
50% of the 9 y/o's could answer correctly
66
Simon and Binet pioneered the first IQ test around 1905; it was created to...
discriminate children without an intellectual disability from children with an intellectual disability
67
Today the Stanford-Binet is used from 2 y/o to adulthood. The IQ formula has been replaced by the...
SAS (standard age score)
68
Most experts would agree that the Wechsler IQ tests gained popularity, as the Binet...
didn't seem to be the best test for adults
69
The best IQ test for a 22 year old single male would be the...
WAIS-IV
70
Describe the WAIS-IV
based on neurocognitive research and the Cattell-Horn-Carroll leading theory of human intelligence
can be administered and scored online, takes about 60-90 minutes
10 subject areas that make up 4 index scores: verbal comprehensive index (VCI), perceptual reasoning index (PRI), working memory index (WMI), and processing speed index (PSI)
FSIQ = full scale IQ, sport a mean of 100 with a standard deviation of 15
less emphasis than the previous version on crystallized intelligence
can measure IQ from 40-160
71
Appropriate age range for the Wechsler Preschool and Primary Scale of Intelligence (WPPSI)?
2 years and 6 months to 7 years and 7 months
72
Appropriate age range for the Wechsler Adult Intelligence Scale (WAIS-IV)?
16-90 years old
73
Appropriate age range for the Wechsler Intelligence Scale for Children (WISC-IV)?
6 years to 16 years 11 months
74
The best intelligence test for a 6th grade girl would be the?
WISC-IV
75
The best intelligence test for a kindergartner would be the...
WPPSI-IV
76
When a test is guided via a theory, it is known as...
theory-based test or inventory
77
The mean on the Wechsler and the Stanford-Binet Intelligence scales (SB5) is ____ and the standard deviation is ______
100; 15 Wechsler, 16 Stanford-Binet
78
Group IQ tests like the Otis-Lennon, the Lorge-Thorndike, and the California Test of Mental Abilities are popular in school settings. The advantage is that...
group tests are quicker to administer
79
The group IQ test movement began...
with the Army Alpha and Army Beta in World War I
80
In a culture-fair test...
items are known to the subject regardless of their culture
81
The black versus white IQ controversy was sparked mainly by a 1969 article written by
Arthur Jensen
82
Who was John Ertl?
claims he invented an electronic machine to analyze neural efficiency and take the place of paper and pencil IQ test. the device relies on a computer, an EEG, a strobe light, and an electrode helmet
the theory is that the faster one processes the perception, the more intelligence they have
83
Who was Raymond B. Cattell?
responsible for the fluid (inherited neurological that decreases with age and isn't very dependent on culture) and crystallized intelligence (intelligence from experiential, cultural, and educational interaction)
84
Who was Arthur Jensen?
he suggested in a 1969 article that the closer people are genetically, the more alike their IQ scores
claimed that whites score 11-15 IQ points higher than African Americans, regardless of social class
his theory stated that due to slavery, it was possible that African Americans were bred for strength rather than intelligence
he estimated that heredity contributed 80% while environment influenced 20% of the IQ
85
Who was Robert Williams?
created the Black Intelligence Test of Cultural Homogeneity (BITCH) to demonstrate that African Americans often excelled when given a test laden with questions whose answers would be familiar to members of the African American community
charged that tests like the Binet and Wechsler were part of "scientific racism"
86
The MMPI-2 is
a standardized personality test; intended to help clinicians diagnose and treat patients; said to have retained the best factors of its original version while updating the test and eliminating sexist wording
87
The word psychometric means
any form of mental testing
88
The Myers-Briggs Type Indicator reflects the work of
Carl Jung
89
The counselor who favors projective measures would most likely be a
psychodynamic clinician
90
An aptitude test is to ___ as an achievement test is to ____
potential; what has been learned
91
Both the Rorschach and the Thematic Apperception Test (TAT) are projective tests. The Rorschach uses 10 inkblot cards while the TAT uses...
pictures
92
Describe the TAT
consists of 31 cards; intended for ages 4+; uses up to 20 cards when administered to any given individual; pictures on cards are intentionally ambiguous; client is asked to make up a story for each card
93
Test bias primarily results from
a test being normed solely on white middle-class clients
94
A counselor who fears the client has an organic, neurological, or motoric difficulty would most likely use the
Bender Gestalt II
95
Describe the Bender Gestalt II
an expressive projective measure; suitable for ages 4+; client's instructed to copy 16 geometric figures which they can look at while constructing their drawing
96
An interest inventory would be least valid when used with
an 8th grade male with an IQ of 136
97
One major criticism of interest inventories is that
they have far too many questions
98
Interest inventories are positive in the sense that
they're reliable and not threatening to the test taker
99
A counselor who had an interest primarily in testing would most likely be a member of
AARC, or Association for Assessment and Research in Counseling
100
The Hamilton Rating Scale for Depression is intended to?
determine the severity of diagnosed depression
101
A t-score has a mean of ___ and a standard deviation of ____
50; 10
102
An IQ score has a mean of ____ and a standard deviation of _____
100; 15
103
What is a z score?
expresses the number of standard deviations that a raw score is from the mean
104
A scatter plot depicts...
pairs of scores
x-axis shows one variable, y-axis shows another variable
105
When should testing not be used?
labeling some individuals
106
What's meant by the term "regression toward the mean"?
most scoring very high or low on a pretest will score nearer the mean on a posttest
107
In "rater bias", a supervisor who rates an employee negatively overall simply because of one very negative attribute is using what type of rater bias?
horns
108
With the horns type of bias...
one negative attribute of someone causes another to rate everything about them more negatively
109
What is not a reason to use nonparametric statistics?
there's normal score distribution
110
If a counselor is conducting an experiment and chooses a significance level of .01, what does this mean?
that the counselor is willing to accept the possibility of erring in accepting or rejecting the null hypothesis one time out of 100
111
Which confounding variable, that can threaten an experiment's validity, is most likely to threaten both internal validity and external validity?
selection of subjects
112
A counselor may decide to administer a number of psychological tests in order to:
better understand the client, predict future performance, and evaluate the outcomes of counseling
113
The Rorschach, TAT, and Rotters Incomplete Sentences are all what kind of tests?
projective
114
