Week 1 - Psychological Tests Flashcards

1
Q

What year did David Wechsler publish an individual adult test of intelligence?

A

1948

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the one thing that all psychological tests are considered to have in common?

A

They are tools that psychologists use to collect data about people. More specifically they are objective procedures for sampling and quantifying human behaviour in order to make inferences using standardised stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define criterion-referenced test

A

A psychological test that uses a predetermined empirical standard as an objective reference point for evaluating the performance of a test taker

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define norm-referenced test

A

A psychological test that uses the performance of a representative group on the test for evaluating the performance of the test taker

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define psychometric properties

A

The criteria that a test has to fulfil in order to be useful; they include how accurate and reproducible the test scores are and how well the test measures what it intends to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are some limitations of psychological tests?

A
  1. They are only tools - they cannot make decisions for test users
  2. They are often used in an attempt to capture the effects of a hypothetical construct
  3. Tests can become obsolete due to the continual development and refinement of theories, technology and the passage of time
  4. Can sometimes disadvantage a subgroup or culture due to their experience or language background
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

A psychological test can be thought of as

A

A sample of items relevant to the construct of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

In terms of decision theory, the base rate involves

A

The sum of false negatives and valid positives

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Test-retest reliability might be found to be low

A

Because the construct being measured varies from time to time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Donald McElwain and George Kearney were responsible for developing the

A

Queensland test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

A psychological test can become obsolete when

A
  1. Society changes to render the tests norms obsolete
  2. Psychological theory develops to render the basis of the test obsolete
  3. Society changes to render the content of items less appropriate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Construct validity is usually restricted to

A

Achievement tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Tests used as a sample of behaviour require

A

The direct performance of the behaviour of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Test reliability can be calculated if

A
  1. Equivalent forms of the test are available
  2. The items of the test are intercorrelated
  3. The test is split into halves
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

The relationship between reliability and test length

A

Is non-linear with larger numbers of items being required at higher levels of reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the difference between psychological testing and psychological assessment?

A

When we talk of psychological testing we are referring to the process of administering a psychological test and obtaining and interpreting the test scores. Psychological assessment is broader and takes into account other forms of information as well as test results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define self-report tests

A

A psychological test that required test takers to report their behaviour or experience
Most common when the interest is in typical behaviour (I.e. Personality and attitudes)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define performance tests

A

A psychological test that requires test takers to respond by answering questions or solving problems
Are used to assess the limits of what a person can do (I.e altitudes or abilities)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define psychometrics

A

Is concerned with psychological measurement and theories that underpin it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What needs to be considered before administering a psychological test?

A
  1. Ensure the test is appropriate - age, education, ethnicity
  2. Ensure a suitable venue
  3. Check all test materials are present and intact
  4. Ensure adequate time is spent becoming familiar with the test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Define a culture-fair test

A

This is a test where there is no systematic distortion of scores resulting from differences in the cultural background of the test taker
There must be an equivalence across cultures in what is termed the tests construct validity and in it’s predictive or criterion validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Define norms

A

Tables of the distribution of scores on a test for specified groups in a population that allow interpretation of any individuals score on a test by comparison to the scores of a relevant group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define item score

A

The score for each item on a test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define raw score total

A

The total score on the test found by summing item scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Define criterion-referencing

A

A way of giving meaning to a test score by specifying the standard that needs to be reached in relation to a limited set of behaviours

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Define norm referencing

A

A way of giving meaning to a test score by relating it to the performance of an appropriate reference group for the person

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Defund linear transformation

A

A transformation that preserves the order and equivalence of distance of original set of scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Define z-score

A

A linear transformation of test scores that expresses the distance of each score from the mean of the distribution of scores in units of the standard deviation of the distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Define percentile

A

An expression of the position of a score in a distribution of scores by dividing the distribution into 100 equal parts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is the deviation IQ?

A

A term that Wechsler used to capture the essential link between his metric for intelligence and the z score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What are the three main ways to determine percentiles?

A
  1. Graphic interpolation
  2. Arithmetic calculation
  3. Reading from the tables of the normal curve
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is the Flynn effect?

A

Refers to a steady increase in scores on IQ tests since about the 1930s - James Flynn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Define reliability

A

The consistency with which a test measures what it purports to measure in any given set of circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Define domain-sampling model

A

A way of thinking about the composition of a psychological test that sees the test as a representative sample of the larger domain of possible items that could be included in the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Define classical test theory

A

The set of ideas, expressed mathematically and statistically, that grew out of attempts in the first half of the 20th century to measure psychological variables; and that turns on the central idea of a score on a psychological test comprising both true and error score composition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Who devised the first of the modern intelligence tests?

A

Binet - he proposed a method of quantifying intelligence in terms of the concept of mental age

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What is the standard error of measurement?

A

An expression of the precision of an individual test score as an estimate of the trait it purports to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Define reliability coefficient

A

An index (often a Pearson product moment correlation coefficient) of the ratio of true score to error score variance in a test as used in a given set of circumstances

I.e the proportion of observed score variance that is due to true score variance

39
Q

Define split-half reliability

A

The estimate of reliability obtained by correlating scores on the two halves of a test formed in some systematic way (odd v. Even)

40
Q

What does the spearman-brown formula tell us

A

It purports to tell us about an otherwise unknown state of affairs

41
Q

Define Cronbach’s alpha

A

An estimate of reliability that is based on the average inter correlation of the items in a test

42
Q

Define test-retest reliability

A

A long-standing approach used by researchers seeking to evaluate reliability because it’s meaning is intuitively obvious.
It is the estimate of reliability obtained by correlating scores on the test obtained on two or more occasions. Traits considered stable should correlate highly

43
Q

Define generalisability theory

A

A set of ideas and procedures that follow from the test construction specifying the desired range of conditions over which the consistency of precision of a test is to hold.
It asks the user to specify what generalisation they are seeking to make and then ask whether there are data that support such a generalisation

44
Q

Define inter-rather reliability

A

An estimate of reliability based on the degree of agreement among raters with respect to the quantification of the construct of interest

45
Q

What rules of thumb did Nunnally (1967) give for assessing reliability?

A

.5 or better for test development
.7 or better for using a test in research
.9 or better for use in individual assessment

46
Q

Define equivalent forms reliability

A

The estimate of reliability of a test obtained by comparing two forms of a test constructed to measure the same construct

47
Q

How can reliability be improved?

A

Extending the sample, that is, lengthening the test

48
Q

Defin validity

A

The extent to which the test measures what it purports to measure

49
Q

Define construct validity

A

Construct validity sees the test as an operation for giving a construct meaning and asks how well it does that

50
Q

Define content validity

A

The meaning that can be attached to a score on a psychological test on the basis of inspection of the material that constitutes the test

51
Q

How is predictive validity evaluated?

A

It is evaluated in terms of the extent to which scores on the test allow us to estimate scores on a criterion external to the test itself

52
Q

Define concurrent validity

A

A form of predictive validity in which the index of social behaviour is obtained close in time to score on the psychological test
I.e prediction when the time interval is minimal

53
Q

What is the standard error of estimate

A

It can be thought of as the standard deviation of the distribution of the differences between actual and predicted scores

54
Q

Define valid positive decisions

A

Those decisions where the person is predicated to show the characteristic of interest and this is in fact the case

55
Q

Define valid negatives

A

Are those in which the prediction is they the person does not show the characteristic of interest and this is the case

56
Q

What are false positives

A

Those decisions in which the prediction is that the person has the characteristic but in fact does not

57
Q

Define false negative

A

Are those decisions in which the prediction is that the person does not have the characteristic of interest

58
Q

Define convergent and discriminate validity

A

The subjection of a multi trait-multimethod matrix to a set of criteria that specify which correlations should be large and which small in terms of a psychological theory of the constructs

59
Q

Define a factor

A

A linear combination of the elements of a data matrix

60
Q

Cronbach and Meehl argued that tests can be invalidated

A

By correlating too highly with tests of constructs they are not supposed to be measuring

61
Q

A psychological test can be thought of as

A

A sample of items relevant to the construct of interest

62
Q

Generalisability theory

A

Is a broader theory of reliability than domain sampling theory

63
Q

Psychological tests are

A

Important tools for psychological research

64
Q

Content validity is usually restricted to

A

Achievement tests

65
Q

The Army Alpha and Beta tests were developed under the leadership of

A

Robert Yerkes

66
Q

The standard score is the basis of which derived score used in psychological testing?

A

The stand score, the standardised score and the t score

67
Q

The standard error of estimate can b determined from the knowledge of the

A

Correlation between test and criterion and the standard deviation of the criterion

68
Q

interpreting and integrating interview data into the psychological report inevitably involves what?

A

clinical judgment

69
Q

In the 1960’s C. Rogers emphasised understanding the proper interpersonal ingredients necessary for optimal therapeutic relationship. Which of the following is NOT one of these?

A

warmth
genuineness
positive regard
directiveness

70
Q

A written psychological report is preferred over a verbal report because

A

it provides and enduring record

71
Q

How many composite scores can be derived from the core subtests of the WAIS-IV?

A

five

72
Q

What are the areas usually covered in a mental status examination?

A

appearance, orientation, affect, thought content and process, and insight

73
Q

What is a psychological test?

A

An objective procedure for sampling and quantifying human behaviour to make an inference about a particular psychological construct using standardised stimuli

74
Q

Why do we need psychological tests?

A

Human judgment is subjective and fallible. There are many factors that can effect human judgment such as stereotyping, personal bias, positive and negative halo effect, errors of central tendency.

Psychologists consider psychological tests better than personal judgment in informing decision making in many situations because of the nature and defining characteristics of these tests

75
Q

What is the difference between psychological testing and assessment?

A

Testing - the process of administering a psychological test and obtaining and interpreting the test scores

Assessment - a broad process of answering referral questions to which includes but is not limited to psychological testing

76
Q

What is a construct?

A

A hypothetical entity with theoretical links to other hypothesised variables, that is postulated to bring about the consistent set of observable behaviours, thoughts or feelings that is the target of a psychological test

77
Q

What is reliability?

A

Reliability is the consistency with which a test measures what it purports to measure in any given set of circumstances

78
Q

What are some of the different types of reliability?

A
inter-rater
test retest
split half
Cronbach's alpha
parallel form
79
Q

What factors can affect the reliability of test results?

A

environmental and time factors
social desirability
individual factors
motivational factors

80
Q

What is validity?

A

The validity of a test has been traditionally defined as the extent to which the test measures what it purports to measure

81
Q

What are the different types of validity?

A
face validity
social validity
content
criterion
construct
predictive
concurrent
82
Q

Z scores have a M of ___ and a SD of ___

A

0; 1

83
Q

T scores have a M of ___ and a SD of ___

A

50; 10

84
Q

Standard scores have a M of ___ and a SD of ___

A

100; 15

e.g. IQ score

85
Q

If a person receives a SS of 100 on an intelligence test, what does this mean?

A

The client is in the middle of the average range in the intelligence test

86
Q

If a person receives a percentile rank of 2 on an intelligence test what does this mean?

A

98% of people scored higher.

The person is in the bottom 2%

87
Q

In the context of psychological testing, what does standardisation mean?

A

The process of administering a test to a representative sample of test takers for the purpose of establishing norms.

88
Q

What are norms?

A

Tables of the distribution of scores on a test for specified groups in a population that allow interpretation of any individual’s score on the test by comparison to the scores for a relevant group

89
Q

What are the different types of norms?

A
demographic background
socio economic status
culture
ethnicity
age
language
location
90
Q

Ideally norm samples should be …………

A

matched to the client
relevant
optimal size (2000 excellent)

91
Q

When test administration is not followed exactly as outlined in a test manual, what are the possible implications?

A

Comparison to the norms will not be accurate - the conclusions drawn may not be relevant

92
Q

Error is an inherent part of psychological testing. True of False? Explain why.

A

TRUE

  • systematic error
  • non-systematic error
93
Q

Psychological tests diagnose individuals. True or False? Explain why.

A

FALSE

- should not be used in isolation