Test lll Flashcards

(44 cards)

1
Q

Evaluation

A

Usually, an ongoing strategy through which student learning is monitored.
An interactive process that engages both teacher and student in monitoring the student’s performance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Means of evaluation:

A

Justify
Negotiate
Modify opinions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Procedures and attitudes are evaluated to:

A

To improve students’ performance
To develop the teaching program
To illuminate the teaching and learning process.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Evaluation is to testing:

A

What curriculum is the syllabus.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Tests

A

Evidence for decision-makers.
Feedback for language students concerning their progress.
Serve as a monitoring device for learning.
Given at a particular point in time to “sample” student learning.
A reporting takes place: a single score or grade.
Have a degree of secrecy in order to assure confidentiality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Testing General principles

A

Usefulness (Bachman & Palmer, 1996)
The Cornerstones (Combee & Hubley, nd)
Procedures
Instruments
Test types
Question types
Weighing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Test qualities: Bachman & Palmer:

A

Usefulness=

Construct Validity
Reliability
Authenticity
Interactiveness
Impact
Practicality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The Cornerstones of Testing
(Coombe & Hubley, nd)

A

Usefulness

Validity
Reliability
Authenticity
Security
Transparency
Washback
Practicality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Test types:

A

Placement (places you in an appropriate course or class)
Progress (Normal test)
Achievement (Graduation, end exam)
Proficiency (Identifies language level by a common framework, developed by external bodies)
Diagnostic (Identifies deficiencies)
Computer-based (can be any)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Test items

A

Closed (objective)
MCQs (objective questions)
Main idea
True/False/Not given
Matching
Finding mistakes
Underlining

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Differentiated instruction because students:

A

Have different needs
Come from different educational backgrounds
Have different attention spans and interests
Have different language abilities
Have different cultural backgrounds

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Alternatives in assessment

A

Emerged in the 1990s.
To assemble additional measures.
To triangulate data about Sts.
To promote fairness and balance.
Contextualized to curriculum.
Referenced to the criteria of that curriculum.
Build intrinsic motivation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Language Ability
(Bachman & Palmer, 1996)

A

Beyond the 4 language skills and several language components…
A “construct”, defined on the basis of performance on language tests, that involves two components:
Language competence = knowledge
Strategic competence = metacognition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Portafolios:

A

A portfolio is a purposeful collection of students’ work that demonstrates to the students and others their efforts, progress, and achievements in given areas.
Specific focus, such as writing, or broad focus that includes examples of all aspects of language development.
Can be Essays, artwork, personal reflections, tests, audio, video.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Benefits of portafolios:

A

Foster
Intrinsic motivation
Responsibility
Tangible evidence of Sts’ work.
Critical thinking
Collaborative work
Assessment of multiple aspects of language learning and aptitudes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Successful portfolios:

A

State objectives clearly
Purpose: Collecting, reflecting, assessing, documenting, linking, evaluating.
Give guidelines on what materials to include.
Communicative assessment criteria to Sts.
Self-Assessment
Peer Assessment
Teacher Assessment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Journals

A

A log (or “account”) of one’s thoughts, feelings, reactions, assessments, ideas, or progress toward goals.
Little attention to structure or form.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Types of journals:

A

Language-learning
Skills, strategies, language categories.
Grammar
Grammar acquisition (awareness of error)
Responses to readings / videos / films /presentations
Self-assessment reflections
Diaries of attitudes, feelings…
Self-understanding.
Dialogue journals.
Interaction between teacher and student

19
Q

Successful journals:

A

Introduce Sts to the concept of journal.
State the objectives (see types)
Give what kind of topics to include.
Clarify assessment criteria
Content is more important than form.
Provide optimal feedback
Cheerleading feedback
Encourage Sts to persevere
Instructional feedback
Strategies, materials
Reality-check feedback
Designate time.
Provide positive final assessment.

20
Q

Conferences and Interviews

A

Conversation that facilitates the improvement of both oral and written work.
One-on-one interaction between teacher and student.
Direct feedback toward a student’s specific needs.

21
Q

Self and Peer-assessments

A

Self-Assessment
Autonomy
To set one’s own goal
Intrinsic motivation

Peer Assessment
Autonomy
Intrinsic motivation
Cooperative learning

22
Q

Types of self and peer assessments

A

Assessment of a specific performance
Indirect assessment of a general competence
Metacognitive assessment
Setting goals
Socio Affective assessment
Social and affective factors in learning.

23
Q

Usefulness principles for Bachman and Palmer

A

1: It is the overall usefulness of the test that is to be maximized, rather than the individual qualities that affect usefulness.
2: The individual test qualities cannot be evaluated independently, but must be evaluated in terms of their combined effect on the overall usefulness of the test
3: Test usefulness and the appropriate balance among the different qualities cannot be prescribed in general, but must be determined for each specific testing situation.

24
Q

Bachman’s and Palmer’s interactiveness

A

The interactiveness of a given language test task can be characterized in the terms of the ways it activates the test takers areas of language knowledge, metacognitive strategies, topical knowledge, and affective schemata.

25
Types of resources
Human resources Material resources Time
26
Validity
Refers to the extent to which a test measures what it says it measures/ TTest what you teach, how you teach it. Includes content validity, construct (method/approach) validity, and face (appearance) validity.
27
Reliability
Refers to the consistency of test scores. It simply means that a test would ive similar results if it were given at another time, and that alternate forms of the same test should give the same result.
28
Three factors that affect reliability:
Test factors (Format, content, length) Administrative factors (Classroom setting, teacher management) Affective factors
29
Threats of reliability
- Fluctuations in the Learner - Fluctuations in scoring - Fluctuations in Test administration
30
Criterion vs norm referenced tests
Criterion (Standards are determined before Escala de estimacion, alternative assesment) Norm referenced: Standards are determined after, Grade depends on average performance, bell curve.
31
Test Development Process
Planning Test Content and development before during after reflect on the test
32
Holistic Marking Scaling
Reviews a whole text as a unit
33
Analytical marking scaling
Reviews different aspects of performance of a text.
34
Common speaking assessment activities
Interview Description of a photograph or item Negotiation task Roleplays Oral presentations
35
Skill contamination
Having one skill affect the grade of another
36
Statistics for classroom testing
The mean pass fail rate histograms
37
Computer Based Testing
Computer-based testing (CBT) has numerous advantages including: * quick, accurate results and feedback * detailed statistical analysis * easy administration with a high level of security * item banks of validated test items * encouragement of certain effective test-taking skills
38
Traditional Assessment vs Alternative Assessment
One-shot tests vs Continuous, longitudinal assessment Indirect tests vs Direct tests Inauthentic tests vs Authentic assessment Individual projects vs Group projects No feedback provided to learners vs Feedback provided to learners Timed exams vs Untimed exams Decontextualized test tasks vs Contextualized test tasks Norm-referenced score interpretation vs Criterion-referenced score interpretation Standardized tests vs Classroom-based tests
39
Cloze procedures:
Removing every nth word from a text.
40
Harmer and ur test items:
Cloze procedures Transformation and paraphrase Sentence reordering Gap Fills Dictation Sentence compilation Translation Mistake correction Wordsearch Unscramble
41
For writing tests:
For writing tests: Assess the situation Decide what to test Balance the elements Weight the scores Make the test work
42
Teacher assessment
Teacher gives a subjective estimate of the students level
43
Continuous assessment
Teacher assessment + summative assessment
44
Practical tips for computer testing
Clarity Doability Marking Interest Varied level