Module 3: The Usability Test Plan Flashcards
Name the 7 elements in the Test Plan
- Experimental design
- Profiles of participants, and recruitment strategy
- Interfaces being evaluated
- Scenarios & tasks
- The test environment
- Tools and measures
- Detailed protocol
what is the purpose of a Test Plan?
it documents all activities needed for the test preparation, execution and analysis
What are the (3) types of Experimental Design?
- Between Subject Design
- Within Subject Design
- Correlation Design
Define between-subject design
different people test each condition, so that each person is only exposed to a single user interface.
Define within-subject design
the same person tests all the conditions (i.e., all the user interfaces).
Type of test used to find usability issues
Correlational Design
How many participants do we need to find 80% of usability issues?
research shows that 8 in 10 participants are needed
Why would we choose Correlation Design over other types of experimental designs?
- time (e.g. version A and B are not at the same maturity level)
- resources (e.g. budget)
why do we use counterbalancing in within-subject design?
to control the test’s results learning effect
why do we use counterbalancing in within-subject design?
to control the test’s results learning effect
what is the minimum # of participants to have for a study? *
12 participants, plus 10-20% to mitigate no-shows
how many participants to recruit for 1 user profile?
6 + 1 (to mitigate no shows) = 7
how many participants to recruit for 2 user profiles?
5 participants x 2 (user profiles) + 2 (to mitigate no shows) = 12
