Testing - AMT - Chapter 9 Flashcards Preview

Z3 - Testing > Testing - AMT - Chapter 9 > Flashcards

Flashcards in Testing - AMT - Chapter 9 Deck (23):
1

According to the authors, the best way to test people’s writing ability is....

to get them to write (test writing ability directly)

2

Writing task problems

- Representative Tasks (population + expected performance)
- Valid samples of writing (represent ability)
- Scored Validly (Can/Will be)

3

How to Create Representative Writing Task

- Specify all possible content
- Include Representative Sample of Specified Content

4

Specify all possible content of a Writing Task

Operations (Describe, explain, compare, etc.)
Types of text
Addressees
Length of texts
Topics
Dialect and style

5

Text Operations
(e.g.)

Describe, explain, compare and contrast, argue for and against a position, etc.

6

ideal writing test for Construct Validity

One which requires candidates to perform all the relevant potential writing tasks.

7

Why writing task with
- Wide ranging 
- Representative sample of specifications

++Validity
++Backwash Effect

8

Really good coverage of the range of potential writing tasks is... 

Not possible in a single version of the test.

9

To know something ACCURATE and MEANINGFUL about a person’s WRITING ability is ALWAYS

- Expensive

10

Elicit a valid sample of writing ability

- Separate tasks (as many as is feasible)
- Test ONLY writing ability
- Restrict candidates

11

Ensure valid and reliable scoring

- Reliably scored tasks
- As many as possible tasks
- Restrict candidates (directly comparable)
- Long enough Samples

12

Scales of Scoring (approaches)

Holistic & Analytic

13

Scales of Scoring
(where in specifications)

Criterial Levels of Performance

14

"""impressionistic"" refers to"

Holistic scoring

15

Holistic Scoring

- Single Score
- Overall Impression

16

Holistic Scoring
- Advantages

Very Rapid (2min)

17

Holistic Scoring
- disadvantages

- Not reliable
- if scored 4 times = reliability improved

18

Analytic Scoring

Seperate Score for each Aspects of a Task

19

Analytic Scoring
- Advantages

- Subskills development in individuals considered
- All Aspects of performance considered by Scorer
- Number of Scores = ++Reliable
- Weight of grade adapted

20

Analytic Scoring
- Disadvantages

- Time consumming to score
- Attention to different aspects distract from overall effect
- Frequency of errors vs. Communication

21

If diagnostic information is required directly from the ratings given

(Analytic or Holistic??)

Analytic scoring is essential

22

Calibrate the scale to be used

1 - Collecting samples of performance
2 - Expert assing sample to point(s) on relevant scale
3 - Result = reference points

23

Training Stages

1 - Background and Overview (study handbook)
2 - Rate + Discuss (handbook answered)
3 - Agreement on how to rate