Selecting, Administering, Scoring, and Interpreting Assessment Results 1 Flashcards
Selecting assessment instruments and strategies: first 4 steps
The choice of instruments or strategies for a specific assessment will depend on several factors, such as?
o The type of information needed
o the needs of the client
o resource constraints
o the time frame available for the assessment
o the quality of the assessment instrument,
o the qualifications of the counselor.
What are the steps when Selecting assessment instruments and strategies?
- Identify the type of information needed
- Identify available information about the client
- Determine the methods for obtaining information about the client
- Search assessment resources
- Evaluate and select an assessment instrument or strategy
What is the first step Selecting assessment instruments and strategies?
1-Identify the type of information needed
why Identifying the type of information needed
Any assessment instrument or strategy is useful only if it provides the information required for the assessment..
How Counselors Identifying the type of information needed? Give an example
based on the purpose for assessment.
• E.g., a career counselor working with a client who wants to change careers will need to obtain information such as the client’s employment history, educational background, aptitudes, interests, and values
What is the second step in Selecting assessment instruments and strategies?
2-Identify available information about the client
What can be the available information about the client?
Identify and review pre-existing assessment information about clients such as:
o questionnaires
o biographical data
o preliminary diagnoses
o school grades/attendance and health records, educational history
o family history
o previous assessment results
Why it is important to Identify available information about the client?
This information can be useful in the current assessment process
Counselor have to be careful not to over-assess or to give the client a test that is similar to a previous they took as this can decrease the motivation of the client.
For example, one school district gave all of its students in grades 9 and 10 the Otis-Lennon School Ability Test, the Differential Aptitude Test, the School and College Ability Tests, and the California Test of Mental Maturity. These tests repeatedly assessed the same factors, and the results of multiple tests did not provide enough additional information to warrant such testing practices.
It may be helpful to develop a checklist of information typically available on clients in a particular context.
What is the third step in Selecting assessment instruments and strategies?
3-Determine the methods for obtaining information about the client
What are the methods for obtaining information about the client? give examples
Counselors can choose from both formal and informal assessment instruments and strategies such as interviews, tests, observations
o E.g. to assess a student learning disability, a counselor can use rating scales, ability tests, and the Functional Behavioral Assessment
o E.g. to assess a student’ s career interests, a counselor can use the interest inventory and an interview
What are recommended for Counselors to do when Determining the methods for obtaining information about the client?
o use a combination of assessment instruments in order to get in depth information
o choose assessment methods that are suitable to the client and the setting
o choose assessment methods that they are qualified to administer
What is the fourth step in Selecting assessment instruments and strategies?
4-Search assessment resources
What are assessment resources?
- There are thousands of formal and informal assessment instruments available
- Counselors need to know how to locate and access information about instruments
- There is no single source avail-able that catalogs every possible formal and informal assessment instrument.
- Sources vary with respect to detail; some provide comprehensive information, while others merely provide descriptions of tests.
What are the The most common sources of information about assessments?
o References sources o Test Publisher Catalogs o Test Manuals o Research Literature o Internet Resources o Professional Organizations o Unpublished Instruments
What are some examples of References sources?
1Mental Measurements Yearbook (1938 Oscar K. Buros)
2Tests in Print (TIP; Anderson, Schlueter, Carlson, & Geisinger, 2016)
3 Tests Critiques and Tests
1Mental Measurements Yearbook (1938 Oscar K. Buros)
What does it provide?
Provide:
- evaluative information needed for informed test selection.
- descriptive information for over 2800 tests, including the publisher, prices, population for whom the test is appropriate, and psychometric information (i.e., reliability, validity, norming data).
- critical reviews by test experts as well as a list of reviewer’s references.
2Tests in Print (TIP; Anderson, Schlueter, Carlson, & Geisinger, 2016)
What is it?
What does it include?
How it help MMY readers?
- It is a comprehensive listing of all commercially available tests
- It includes the same basic information about a test that is included in the MMY, but it does not contain reviews or psychometric information.
- The TIP guides readers to the MMY for more detailed information about tests
3 Tests Critiques and Tests
What is test and what is test Critiques?
Tests provides a comprehensive listing of all tests available in the English language. It provides descriptions of tests but does not contain critical reviews or psychometric information; this information can be found for selected instruments in Test Critiques.
Test Critiques, designed to be a companion to Tests, contains a three-part description for each test that includes Introduction, Practical Application/Uses, and Technical Aspects. It also provides psychometric information and a critical review of each test.
What are the advantages and disadvantages of Tests Critiques and Tests?
Advantages:
- Contain critical reviews of the test by experts Contain bibliography of studies done using the test, such as those to assess the validity and reliability of the test
Disadvantages:
- May present dated information because some volumes are published infrequently
- Can present a spotty or biased review because reviewers do not follow a common format
- Do not discuss thoroughly the purposes and pos-sible applications of the test
What does Test Publisher Catalogs provide and include? And what do they not provide?
(provide descriptions of the most recent editions of tests as well as costs and scoring)
The information may include the cost of materials and scoring, types of scoring services, and ancillary materials available through the publisher.
It is important to remember that publishers’ websites are marketing tools aimed at selling products; they do not provide all the information needed to fully evaluate a test.
What are the advantages and disadvantages of Test Publisher Catalogs?
Advantages:
Can get current information on the cost of the test and scoring services available
Can get information on new tests and ser-vices available
Disadvantages:
Sometimes presents biased picture of the test
Sometimes does not have necessary technical and practical information, such as time required, age or grade levels appropriate, sources from which to get complete test package, and basic information to screen quickly for appropriateness (such as a description of scales or subtests)
Test Manuals: From who? What does it provide? Tests manuals should be? What are their role in the test selection process?
Test manuals, available from test publishers
provide administrative and technical information about a test.
The manual should provide information about test specifications (i.e., purpose of the test, definition of constructs measured, description of the population for which the test is intended, and information about interpretation) and general standards for the preparation and publication of test documentation: manuals and user guides
Tests manuals should be complete, accurate, current, and clear.
because most of the information one would want about a particular psychological or educational test can be found in test manuals, they are the primary source to consult in the test selection process.
What are the advantages and disadvantages of Test Manuals?
Advantages:
Provide in-depth information on the nature of the instrument
Describe the processes involved in test development
Provide technical information Describe norm groups
Provide guidelines for administration and interpretation
Disadvantages:
May present dated and biased material
Can be highly technical or oversimplified May require background in measurement theory
Research Literature:
What is it
Where is it found?
Advantages and Disadvantages?
specific journal articles on test reviews or about research studies using specific tests can provide professionals with information about widely used assessment instruments.
(published research in Academic journals related to Assessment provide specific information about assessments used in education, psychology, and other)
Advantages
Contains validity and reliability studies
Contains reviews of certain instruments
Contains research on issues in assessment
Disadvantage
Contains spotty reviews without a common for-mat and reviews only a few tests
May take 2 to 3 years to get information into print because of publication backlog