Week 9

Question 1

What are the goals of Usability? (3)

Answer 1

Effectiveness, Efficiency and satisfaction

Question 2

What is a conceptual model?

Answer 2

A high-level description of how a system is organised

Question 3

What are the goals of evaluation? (3)

Answer 3

Assess the extent of system functionality
Assess the effect on the user
Identify specific problems

Question 4

What is the ISO definition of usability?

Answer 4

Usability refers to the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of user

Question 5

What does subjective mean in terms of ID?

Answer 5

subjective refers to opinions and feelings which are personal to each individual

Question 6

What does objective mean in terms of ID?

Answer 6

Something that can be accurately measured, not an emotion.

Question 7

What does Usability measure?

Answer 7

Usability measures the quality of a user’s experience when interacting with a product or system.

Question 8

What happens in a typical user-based evaluation?

Answer 8

Participants are asked to perform a set of tasks with the technology developed.

Question 9

What is quantitative data?

Answer 9

Data to do with numbers

Question 10

What is qualitative data?

Answer 10

Data that contains words e.g. interviews and questionnaires.

Question 11

What are some categories of evaluation? (4)

Answer 11

• Lab controlled studies
• Field/in the wild studies
• Observation methods
• Questionnaires, Interviews, Focus Groups

Question 12

Where is usability testing typically conducted?

Answer 12

in a laboratory or a natural setting

Question 13

What methods does Usability testing involve typically? (3)

Answer 13

• User Interviews
• Participatory Design
• User Questionaries

Question 14

True or False: Some methods can collect both quantitive and qualitative data.

Answer 14

True, for example: Questionnaires can have both ratings-based questions and open-ended questions

Question 15

What are some considerations of testing methods?

Answer 15

• Reliability
• Validity
• Bias
• Scope

Question 16

What is the reliability of a method?

Answer 16

Make sure that repeating the experiment will give you similar results

Question 17

What is the Validity of a method?

Answer 17

The accuracy of a method to measure what it is intended to measure

Question 18

What is the Bias of a method?

Answer 18

The unintentional influence of the experimenter’s expectations, beliefs or preconceived notions on the outcome of a study or research experiment

Question 19

What is the Scope of a method?

Answer 19

The boundaries and extent of a study - “This study is designed to investigate x attributes”

Question 20

What are Questionnaires common for?

Answer 20

Collecting User Feedback

Question 21

What are the advantages of using a standardised questionnaire?(3)

Answer 21

• It measures exactly what you want it to measure
• Do not have to design the questionnaire yourself (resource-saving)
• You can compare scores across other designs

Question 22

What are the 3 types of interviews used in Testing and Evaluation>

Answer 22

• Structured
• Semi-structured
• unstructured

Question 23

What are the Advantages of Interviews? (4)

Answer 23

• Can be varied to suit context
• issues can be explored more fully
• can elicit user views and identify unanticipated problems
• relatively cheap

Question 24

What are the disadvantages of Interviews? (2)

Answer 24

• Can be subjective
• Time Consuming