15 - DEVELOPMENT OF INSTRUMENT

Question 1

● The test is a measuring tool to comprehend one’s cognitive skill.
● It is also a device to gather information needed for evaluation.
● It is a set of questions or exercises to evaluate student;s skills and knowledge.
● It is to determine if the set objectives for a course are achieved.
● It is to determine the academic progress of the student.
● It can reveal the problem or difficulty areas of the student.
● It is used to predict outcomes

Answer 1

Why is there a need for tests?

Question 2

1. Determine the purpose of the test.
2. Identify the learning outcomes to be measured in terms of specific, and observable behavior.
3. Outline the topics.
4. Prepare a table for specifications as a basis for preparing a test.
5. Determine the type of test.

Answer 2

Steps in Constructing a Test

Question 3

● Serves as guide for teachers to translate their instructional objectives, the cognitive level of instruction and the adequacy of the test to be assessed.
● A guide to the item construction on the relative importance of each component in the syllabus and each level of the cognitive domain.
● It improves the validity of the teachers’ evaluation based on a given assessment.
● It is useful for teachers to support their proficient judgment in creating a test.
● It provides a framework for organizing information regarding the students’
instructional experience.

Answer 3

Table for Specifications (TOS)

Question 4

Revised Bloom’s Taxonomy (lowest to highest)

Answer 4

1. Knowledge
2. Comprehension
3. Application
4. Analysis
5. Evaluation
6. Synthesis

Question 5

• Recall or recognize learned information.
• Be able to validate and produce correct statements.

Answer 5

Knowledge/Remembering

Question 6

• Interpret, translate, organize, compare learned information, mental or psychomotor procedure.
• Identify similarities and differences among objects or concepts and to conclude or inference

Answer 6

Comprehension/Understanding

Question 7

• Make use of information in a context to execute and implement procedures.
• Apply acquired knowledge, facts, techniques, and rules to solve problems.

Answer 7

Application/Applying

Question 8

• Break learned information into an organization and different parts to best understand the context and to find evidence to support generalizations

Answer 8

Analysis/Analyzing

Question 9

• Make a judgment about information, the validity of ideas or quality of work based on a set of criteria, standards, in-depth reflection and criticism.

Answer 9

Evaluation/Evaluating

Question 10

• Reorganize the elements into a functional whole.
• Creates new ideas and information from what has been previously learned.
• Propose alternative solutions.

Answer 10

Synthesis/Creating

Question 11

1. Determine the desired number of items
2. List the topics with the corresponding allocation of time (weights)
3. Determine the length of time spent in teaching for each essential topic.
4. Determine the total number of items per topic: total items x weight = total items per topic.
5. Determine the percentage allocation per domain

Answer 11

How to construct a Table of Specifications

Question 12

Guidelines for Developing Different types of Items

Answer 12

1. Objective-Item correspondence
2. Item sufficiency
3. Item must be free from ambiguity as possible
4. Item difficulty
5. Item novelty

Question 13

• The item should directly correspond to the intended behavioral outcome or objective.

Answer 13

Objective-Item correspondence

Question 14

• The correct responses to an item constitute sufficient evidence for the intended behavior outcome.

Answer 14

Item sufficiency

Question 15

An item should communicate with the test takers. The test developer and test taker must have the interpretation of the item.

Answer 15

Item must be free from ambiguity as possible

Question 16

The appropriate level of difficulty should be balanced by including items from all the levels of the continuum.

Answer 16

Item difficulty

Question 17

The measurement of higher-order outcomes or the ability to apply principles. Write items to measure what students know and not an item that is unfamiliar to the students or top

Answer 17

Item novelty

Question 18

Allocation of the estimated time for each type of test can ensure balanced time in answering the achievement test, it can neither be under-timed nor over-timed.

Answer 18

Distribution of Time for each type of Achievement Test

Question 19

• The difficulty level of questions must consider the heterogeneity or homogeneity of the students, performance standards, learning objectives, and the ability of the students that are appropriate to the normal distribution curve.
• The allocation of percentages/items is depending on the previous standards and experience.

Answer 19

The difficulty level of an Item

Question 20

True or False
Multiple Choice
Matching Type

Answer 20

Objective Test

Question 21

It is a kind of written examination where students have to write an essay in response to one or more questions.

Answer 21

Essay Test

Question 22

• Is a declarative sentence statement
• It assesses students the essential outcomes in a simple and direct means
• Are used on exams to quickly determine a student’s understanding of facts, address misconceptions, and generate information recall.

Answer 22

True or False

Question 23

1. Do not provide extraneous clues
2. Statements must be irrevocably true or false
3. Sparingly avoid the use of negative statements and double negatives
4. Limit statements to a single significant concept
5. Keep the statements short and use simple language structure
6. Opinion statement should be attributed to some source
7. The item is worded concise

Answer 23

Rules for constructing true or false items

Question 24

• It is a factual statement. It is the most highly regarded and widely used.
• Provides a stem that may be a question or an incomplete statement. A choice of test if one want to go beyond recall information
• It consists of four or five alternative responses in which only the best/correct answer is selected and the others are plausible wrong answers or distractors.

Answer 24

Multiple choice

Question 25

1. State the problem clearly in the stem.
2. All the questions should be relevant and not far-fetched.
3. Avoid tricky questions.
4. The instruction must be clear, unambiguous, and precise.
5. The vocabulary level and the difficulty of the item should correspond to the level of the learners.
6. Avoid the use of clues that can answer
   the other test item.
7. Provide blank space at the end of the stem when using an incomplete statement.
8. All items should be independent.
9. Keep the stem wordy and keep the option/response as short as possible.
10. The stem should only contain one main idea.
11. State the stem in positive form,
    whenever possible.
12. Sparingly use the negative word.
13. The length of all options should be almost equal.
14. The distractors must be plausible and attractive to the uninformed.
15. Use “All of the above” or “None of the
    above” only when the answer key can be
    classified unequivocally as correct or
    incorrect.
16. The correct answers must be placed in random order.

Answer 25

Rules for constructing multiple choice

Question 26

• A modification of the Multiple-choice form and usually limited to factual formation.
• Composed of 2 sets of terms, events, phrases, definitions and statements.
• First set is named as the premises which as listed in one column and usually placed on the left side, and the other set is named as the responses which are listed in another column and placed on the right side.

Answer 26

Matching Type

Question 27

1. Choose homogenous material for each set item of the matching cluster.
2. Keep the list of items relatively short.
3. Avoid “perfect matching” The set of items is not wholly independent. Using more responses than premises prevents perfect matching.
4. Some premises are larger or smaller than the responses.
5. Arranging the premises or responses in alphabetical order prevents give away
   clues.
6. The directions must be explaining the basis for matching.
7. Use the longer phrases for premises, the shorter for responses.

Answer 27

Rules for constructing Matching Type

Question 28

• A subjective type of test as it allows free expression of one’s
  opinion in a logical and relevant to the
  topic or on a particular topic.
• It assesses higher-order thinking Skills.
• Also measures understanding of the topic through organized thoughts, critical thinking, creativeness, and originality.
• is in the form of descriptive, explanatory, discussion, comparison, illustrative, and criticism

Answer 28

Essay

Question 29

1. Be specific.
2. Instructions must be clear, unambiguous, and precise.
3. Questions must be clear to measure the learning outcomes such as discuss, describe, compare and contrast, define, construct, summarize, explain, enumerate, and illustrate.
4. Use appropriate verbs for the expected level of thinking.
5. Allow sufficient time and indicate time limits for every question. For example allotting 1 minute for students to answer

Answer 29

Rules for constructing Essay Test

Question 30

• A tool that reflects the expectations of an instructor for a task done
• Identifies the strength and weaknesses of the course topics that need improvement, the student’s ability and the instructor’s performance.
• A good rubric must be designed with care and precision for quality feedback and fair grade allocation.

Answer 30

Rubric

Question 31

1. Identify the task and define the goals. Figure out the task to be done and the
   expected learning outcomes.
2. Determine the criteria or dimensions of quality. Define the characteristics of the highest level of performance for each
   criterion.
3. Identify the performance level or levels of mastery. Allocate points in each level of mastery.
4. Write descriptors for each level. Supply the description for each category at a particular performance level, for example:
   a. Distinguished, Proficient, Apprentice, and Novice
   b. Exemplary, Accomplished, Developing, and Beginning

Answer 31

Steps to create a Rubric