Week 1 - Psychological Tests Flashcards

(93 cards)

1
Q

What year did David Wechsler publish an individual adult test of intelligence?

A

1948

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the one thing that all psychological tests are considered to have in common?

A

They are tools that psychologists use to collect data about people. More specifically they are objective procedures for sampling and quantifying human behaviour in order to make inferences using standardised stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define criterion-referenced test

A

A psychological test that uses a predetermined empirical standard as an objective reference point for evaluating the performance of a test taker

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define norm-referenced test

A

A psychological test that uses the performance of a representative group on the test for evaluating the performance of the test taker

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define psychometric properties

A

The criteria that a test has to fulfil in order to be useful; they include how accurate and reproducible the test scores are and how well the test measures what it intends to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are some limitations of psychological tests?

A
  1. They are only tools - they cannot make decisions for test users
  2. They are often used in an attempt to capture the effects of a hypothetical construct
  3. Tests can become obsolete due to the continual development and refinement of theories, technology and the passage of time
  4. Can sometimes disadvantage a subgroup or culture due to their experience or language background
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

A psychological test can be thought of as

A

A sample of items relevant to the construct of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

In terms of decision theory, the base rate involves

A

The sum of false negatives and valid positives

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Test-retest reliability might be found to be low

A

Because the construct being measured varies from time to time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Donald McElwain and George Kearney were responsible for developing the

A

Queensland test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

A psychological test can become obsolete when

A
  1. Society changes to render the tests norms obsolete
  2. Psychological theory develops to render the basis of the test obsolete
  3. Society changes to render the content of items less appropriate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Construct validity is usually restricted to

A

Achievement tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Tests used as a sample of behaviour require

A

The direct performance of the behaviour of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Test reliability can be calculated if

A
  1. Equivalent forms of the test are available
  2. The items of the test are intercorrelated
  3. The test is split into halves
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

The relationship between reliability and test length

A

Is non-linear with larger numbers of items being required at higher levels of reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the difference between psychological testing and psychological assessment?

A

When we talk of psychological testing we are referring to the process of administering a psychological test and obtaining and interpreting the test scores. Psychological assessment is broader and takes into account other forms of information as well as test results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define self-report tests

A

A psychological test that required test takers to report their behaviour or experience
Most common when the interest is in typical behaviour (I.e. Personality and attitudes)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define performance tests

A

A psychological test that requires test takers to respond by answering questions or solving problems
Are used to assess the limits of what a person can do (I.e altitudes or abilities)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define psychometrics

A

Is concerned with psychological measurement and theories that underpin it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What needs to be considered before administering a psychological test?

A
  1. Ensure the test is appropriate - age, education, ethnicity
  2. Ensure a suitable venue
  3. Check all test materials are present and intact
  4. Ensure adequate time is spent becoming familiar with the test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Define a culture-fair test

A

This is a test where there is no systematic distortion of scores resulting from differences in the cultural background of the test taker
There must be an equivalence across cultures in what is termed the tests construct validity and in it’s predictive or criterion validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Define norms

A

Tables of the distribution of scores on a test for specified groups in a population that allow interpretation of any individuals score on a test by comparison to the scores of a relevant group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define item score

A

The score for each item on a test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define raw score total

A

The total score on the test found by summing item scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Define criterion-referencing
A way of giving meaning to a test score by specifying the standard that needs to be reached in relation to a limited set of behaviours
26
Define norm referencing
A way of giving meaning to a test score by relating it to the performance of an appropriate reference group for the person
27
Defund linear transformation
A transformation that preserves the order and equivalence of distance of original set of scores
28
Define z-score
A linear transformation of test scores that expresses the distance of each score from the mean of the distribution of scores in units of the standard deviation of the distribution
29
Define percentile
An expression of the position of a score in a distribution of scores by dividing the distribution into 100 equal parts
30
What is the deviation IQ?
A term that Wechsler used to capture the essential link between his metric for intelligence and the z score
31
What are the three main ways to determine percentiles?
1. Graphic interpolation 2. Arithmetic calculation 3. Reading from the tables of the normal curve
32
What is the Flynn effect?
Refers to a steady increase in scores on IQ tests since about the 1930s - James Flynn
33
Define reliability
The consistency with which a test measures what it purports to measure in any given set of circumstances
34
Define domain-sampling model
A way of thinking about the composition of a psychological test that sees the test as a representative sample of the larger domain of possible items that could be included in the test
35
Define classical test theory
The set of ideas, expressed mathematically and statistically, that grew out of attempts in the first half of the 20th century to measure psychological variables; and that turns on the central idea of a score on a psychological test comprising both true and error score composition
36
Who devised the first of the modern intelligence tests?
Binet - he proposed a method of quantifying intelligence in terms of the concept of mental age
37
What is the standard error of measurement?
An expression of the precision of an individual test score as an estimate of the trait it purports to measure
38
Define reliability coefficient
An index (often a Pearson product moment correlation coefficient) of the ratio of true score to error score variance in a test as used in a given set of circumstances I.e the proportion of observed score variance that is due to true score variance
39
Define split-half reliability
The estimate of reliability obtained by correlating scores on the two halves of a test formed in some systematic way (odd v. Even)
40
What does the spearman-brown formula tell us
It purports to tell us about an otherwise unknown state of affairs
41
Define Cronbach's alpha
An estimate of reliability that is based on the average inter correlation of the items in a test
42
Define test-retest reliability
A long-standing approach used by researchers seeking to evaluate reliability because it's meaning is intuitively obvious. It is the estimate of reliability obtained by correlating scores on the test obtained on two or more occasions. Traits considered stable should correlate highly
43
Define generalisability theory
A set of ideas and procedures that follow from the test construction specifying the desired range of conditions over which the consistency of precision of a test is to hold. It asks the user to specify what generalisation they are seeking to make and then ask whether there are data that support such a generalisation
44
Define inter-rather reliability
An estimate of reliability based on the degree of agreement among raters with respect to the quantification of the construct of interest
45
What rules of thumb did Nunnally (1967) give for assessing reliability?
.5 or better for test development .7 or better for using a test in research .9 or better for use in individual assessment
46
Define equivalent forms reliability
The estimate of reliability of a test obtained by comparing two forms of a test constructed to measure the same construct
47
How can reliability be improved?
Extending the sample, that is, lengthening the test
48
Defin validity
The extent to which the test measures what it purports to measure
49
Define construct validity
Construct validity sees the test as an operation for giving a construct meaning and asks how well it does that
50
Define content validity
The meaning that can be attached to a score on a psychological test on the basis of inspection of the material that constitutes the test
51
How is predictive validity evaluated?
It is evaluated in terms of the extent to which scores on the test allow us to estimate scores on a criterion external to the test itself
52
Define concurrent validity
A form of predictive validity in which the index of social behaviour is obtained close in time to score on the psychological test I.e prediction when the time interval is minimal
53
What is the standard error of estimate
It can be thought of as the standard deviation of the distribution of the differences between actual and predicted scores
54
Define valid positive decisions
Those decisions where the person is predicated to show the characteristic of interest and this is in fact the case
55
Define valid negatives
Are those in which the prediction is they the person does not show the characteristic of interest and this is the case
56
What are false positives
Those decisions in which the prediction is that the person has the characteristic but in fact does not
57
Define false negative
Are those decisions in which the prediction is that the person does not have the characteristic of interest
58
Define convergent and discriminate validity
The subjection of a multi trait-multimethod matrix to a set of criteria that specify which correlations should be large and which small in terms of a psychological theory of the constructs
59
Define a factor
A linear combination of the elements of a data matrix
60
Cronbach and Meehl argued that tests can be invalidated
By correlating too highly with tests of constructs they are not supposed to be measuring
61
A psychological test can be thought of as
A sample of items relevant to the construct of interest
62
Generalisability theory
Is a broader theory of reliability than domain sampling theory
63
Psychological tests are
Important tools for psychological research
64
Content validity is usually restricted to
Achievement tests
65
The Army Alpha and Beta tests were developed under the leadership of
Robert Yerkes
66
The standard score is the basis of which derived score used in psychological testing?
The stand score, the standardised score and the t score
67
The standard error of estimate can b determined from the knowledge of the
Correlation between test and criterion and the standard deviation of the criterion
68
interpreting and integrating interview data into the psychological report inevitably involves what?
clinical judgment
69
In the 1960's C. Rogers emphasised understanding the proper interpersonal ingredients necessary for optimal therapeutic relationship. Which of the following is NOT one of these?
warmth genuineness positive regard *directiveness*
70
A written psychological report is preferred over a verbal report because
it provides and enduring record
71
How many composite scores can be derived from the core subtests of the WAIS-IV?
five
72
What are the areas usually covered in a mental status examination?
appearance, orientation, affect, thought content and process, and insight
73
What is a psychological test?
An objective procedure for sampling and quantifying human behaviour to make an inference about a particular psychological construct using standardised stimuli
74
Why do we need psychological tests?
Human judgment is subjective and fallible. There are many factors that can effect human judgment such as stereotyping, personal bias, positive and negative halo effect, errors of central tendency. Psychologists consider psychological tests better than personal judgment in informing decision making in many situations because of the nature and defining characteristics of these tests
75
What is the difference between psychological testing and assessment?
Testing - the process of administering a psychological test and obtaining and interpreting the test scores Assessment - a broad process of answering referral questions to which includes but is not limited to psychological testing
76
What is a construct?
A hypothetical entity with theoretical links to other hypothesised variables, that is postulated to bring about the consistent set of observable behaviours, thoughts or feelings that is the target of a psychological test
77
What is reliability?
Reliability is the consistency with which a test measures what it purports to measure in any given set of circumstances
78
What are some of the different types of reliability?
``` inter-rater test retest split half Cronbach's alpha parallel form ```
79
What factors can affect the reliability of test results?
environmental and time factors social desirability individual factors motivational factors
80
What is validity?
The validity of a test has been traditionally defined as the extent to which the test measures what it purports to measure
81
What are the different types of validity?
``` face validity social validity content criterion construct predictive concurrent ```
82
Z scores have a M of ___ and a SD of ___
0; 1
83
T scores have a M of ___ and a SD of ___
50; 10
84
Standard scores have a M of ___ and a SD of ___
100; 15 | e.g. IQ score
85
If a person receives a SS of 100 on an intelligence test, what does this mean?
The client is in the middle of the average range in the intelligence test
86
If a person receives a percentile rank of 2 on an intelligence test what does this mean?
98% of people scored higher. | The person is in the bottom 2%
87
In the context of psychological testing, what does standardisation mean?
The process of administering a test to a representative sample of test takers for the purpose of establishing norms.
88
What are norms?
Tables of the distribution of scores on a test for specified groups in a population that allow interpretation of any individual's score on the test by comparison to the scores for a relevant group
89
What are the different types of norms?
``` demographic background socio economic status culture ethnicity age language location ```
90
Ideally norm samples should be ............
matched to the client relevant optimal size (2000 excellent)
91
When test administration is not followed exactly as outlined in a test manual, what are the possible implications?
Comparison to the norms will not be accurate - the conclusions drawn may not be relevant
92
Error is an inherent part of psychological testing. True of False? Explain why.
TRUE - systematic error - non-systematic error
93
Psychological tests diagnose individuals. True or False? Explain why.
FALSE | - should not be used in isolation