UX Exam (modules 7-10)

Question 1

What is visual design?

Answer 1

“The practice of…
* devising grids,
* laying out pages,
* choosing colour palettes and
* developing icons”

Question 2

Fundamental principles of visual design?

Answer 2

Proximity, Alignment, Repetition, Contrast (PARC)

Question 3

What are the Gestalt principles?

Answer 3

Principles of how humans perceive objects - they group similar elements, recognise patterns and simplify complex images

Question 4

Explain Gestalt principle of proximity?

Answer 4

Objects are perceived as being related if they are close together

Question 5

Explain Gestalt principle of similarity?

Answer 5

Objects are perceived as being related if they are similar in colour, shape, size or orientation

Question 6

Explain Gestalt principle of figure ground?

Answer 6

Objects are perceived as either the foreground or background - the main figure is what we focus on, and the rest is background

Question 7

Explain Gestalt principle of closure?

Answer 7

Our brains will fill in a missing part to create a complete picture (e.g. a circle with a small gap is still perceived as a circle)

Question 8

Explain Gestalt principle of continuation?

Answer 8

Objects placed on a line or curve are perceived as more related than those that are not aligned

Question 9

Explain Gestalt principle of enclosure?

Answer 9

Objects with a border around them are perceived as more related to each other

Question 10

How can you create a clear hierarchy in a UI?

Answer 10

Arrange elements according to importance, group similar elements in proximity to each other to suggest a relationship, direct viewer’s attention by using size, visual weight, colour and position (e.g. indenting)

Question 11

Two main types of balance?

Answer 11

Symmetrical and asymmetrical

Question 12

How can contrast be useful?

Answer 12

It can be used to guide the user to important content and tasks, it helps make a design accessible to all users, it can help draw attention to call to action buttons

Question 13

Considerations to take with colours?

Answer 13

Can use colour to imply relationships and associations, important for brand recognition, beware of cultural differences

Question 14

What are primary, secondary and tertiary colours?

Answer 14

Primary - yellow, red, blue
Secondary - mixing primaries together (green, orange, purple)
Tertiary - mixing secondary colours together

Question 15

Types of colour schemes?

Answer 15

Monochromatic - different variations of one colour
Sympathetic - colours close to each other on colour wheel
Complementary - colours that are direct opposites on the colour wheel

Question 16

Accessibility considerations with colours?

Answer 16

Always put dark foregrounds against light backgrounds or vice versa, don’t put red with green/blue, ensure good contrast, never use colour alone to differentiate between items

Question 17

What is skeuomorphism?

Answer 17

When a digital object mimics its real world counterpart

Question 18

What are advantages of using visual metaphors? (skeuomorphism)

Answer 18

Can put abstract concepts in concrete terms, they create familiarity, they can trigger emotions, can draw the attention of users, can motivate users into action

Question 19

What are disadvantages of using visual metaphors?

Answer 19

May only be helpful for inexperienced users, can create functional limitations dictated by real world object, adds clutter to designs, may not cross cultures/languages/generations

Question 20

How can one reduce cognitive load on the user?

Answer 20

User should not have to remember information from one part of the system to another - present info in meaningful & distinct chunks, make supporting tools & information readily available, every element should have a definitive purpose

Question 21

What are some elements of information flow?

Answer 21

Perceptions, predispositions, person, goals, actions, social environment, physical environment, technical environment, system, interaction

Question 22

How do users tend to view content?

Answer 22

F-shaped reading pattern

Question 23

What are the W3C web content accessibility standards?

Answer 23

Important standard: legal requirement, inclusive design, business reasons, improves experience for all

Question 24

What are the first 5 usability heuristics?

Answer 24

1 - Consistency & standards (follow conventions, present similar functions consistently)
2 - Match between system & real world (use words, phrases, concepts familiar to the user, don’t use jargon, think about users expectations around the system
3 - Visibility of system status (keep users informed about what is going on with feedback, progress indicators, active menu items, breadcrumbs)
4 - User control and freedom (don’t trap users in a process or transaction in case they got there by mistake)
5 - Flexibility and efficiency of use (responsive and easy to use by novices & experts alike)

Question 25

What are the next 5 usability heuristics?

Answer 25

6 - Aesthetic & minimalist design (visually appealing designs are perceived as more credible & easier to use)
7 - Help users recognise, diagnose & recover from errors (precisely explain the problem, show fields with an error)
8 - Error prevention (e.g. calendar pickers)
9 - Help & documentation (include contextual help, don’t rely on human memory)
10 - Recognition rather than recall (icons/symbols should be meaningful & recognisable, don’t rely on users’ memory)

Question 26

What should calendar pickers not be used for?

Answer 26

Date of birth (date range too wide), just use for dates within 2 years. Be careful on mobile since it includes small touch target areas

Question 27

What are the accessibility principles?

Answer 27

Web content should be:
* Perceivable: the user must have access to the content and controls in a form that they can perceive (K2)
* Operable: it must be possible for the user to operate the navigation and other controls with a device that they are able to use, such as the keyboard (K2)
* Understandable: the user must be able to read or hear and interpret the text that is presented, and predict the way the system will respond to their actions (K2)
* Robust: the content must be coded in such a way that it can be interpreted by a wide range of device software, including assistive technology (K2)

Question 28

Benefits of multivariate testing?

Answer 28

Good if site is live and want to optimise site, avoid having to run multiple A/B tests, measure the contribute of each variable, measure the interaction effects between independent elements

Question 29

Disadvantages of multivariate testing?

Answer 29

Not good for early prototype testing, need a significant sample size, higher complexity than A/B testing or usability testing, doesn’t tell you the why

Question 30

What are heuristic evaluations?

Answer 30

Desktop usability reviews against usability guidelines & principles

Question 31

What are cognitive walkthroughs?

Answer 31

Usability specialists construct task scenarios based on their understanding of typical users and their key goals. The evaluator then assumes the role of a user & walks through the interface as outlined in the task scenario. Each decision and step the user would take is analysed and points of confusion or barriers to task completion are documented.

Question 32

Where is a cognitive walkthrough better than a heuristic evaluation?

Answer 32

Better at determining whether a site/system will meet core user goals

Question 33

Compare usability inspection (expert reviews) against usability testing

Answer 33

Usability inspections are quick & affordable. Usability testing is less reliant on expert knowledge, more accurate (reflects real user experiences), less subjective

Question 34

What is a formative usability test vs a summative usability test?

Answer 34

Formative: aims to find problems with a system so they can be fixed. Typically involves ‘Think aloud protocol’ (where users talk through what they are thinking with a moderator as they use the design). Often done in the early stages of a project on prototypes to discover insights and be sure you are designing the right thing.
Summative: aims to measure usability metrics, such as effectiveness, efficiency and satisfaction. Typically done half of the development phase, testing with actual working prototypes or the site or system before or after launch.

Question 35

What are the benefits of usability testing at the analysis/discovery stage?

Answer 35

Understand the current state of your site, identify usability issues preventing users from completing tasks, helps define project scope and goals

Question 36

What are the benefits of usability testing at the design stage?

Answer 36

• Identify major usability issues early when they are easy and inexpensive to fix.
• Identify major flaws in interaction flow prior to coding.
• Measure alignment with branding goals.

Question 37

What are the benefits of usability testing at the production/build/beta stage?

Answer 37

• Establish or validate that the site meets an acceptable standard before it is released.
• Identify any ‘showstopper’ issues for users pre-launch.
• Identify other issues to be fixed after launch or in next release.

Question 38

What are the benefits of usability testing at the evolution/live stage?

Answer 38

• Identify usability issues to fix as users evolve.
• Refine your website to encourage greater online migration of your customers from other channels or competitors.
• Understand where customers would expect to find new functionality and content.

Question 39

What are the key steps for usability testing?

Answer 39

Write a test plan, recruit users, write tasks for testing, run pilot test & prepare, conduct test, analyse & document results, iterate

Question 40

What should you include in a test plan?

Answer 40

Objectives & approach - should be specific and measurable. What do you want to know? What are the suspected problem areas?
Key deliverables or artefacts - what will you change in the product after testing?

Question 41

Test method approaches for learning about user opinions or attitudes?

Answer 41

• First impressions - Five second test (show them the page or site for 5 seconds)
• Brand – After using the site, use semantic scales with brand values at one end and the opposite at the other end (e.g. ‘Traditional’ at one end and ‘Modern’) and ask users to indicate on the scale how this website makes them feel).
• Pre vs. post-test evaluations – measure change e.g. motivation level (or brand alignment) before they use the website (or after 5 seconds) and compare to motivation level after they have tried to complete number of tasks using the site or system).

Question 42

Test method approaches for learning about usability issues with your system

Answer 42

Task based testing
* Natural tasks (things users actually want to do themselves or have attempted in the past)
* Prescribed tasks (that you have written based on common user goals)
* Think aloud protocol – get users to talk through what they are doing

Question 43

Test method approaches for learning about content comprehension

Answer 43

Task based testing
* Prescribed tasks (that you have written based on common user goals)
* Prompts or questions to ask users to explain their interpretation or provide you with an answer to a question

Question 44

Test method approaches for learning about how your design compares to other versions or competitors

Answer 44

• Comparative testing – test 2-3 different concepts or sites with each participant – alternate order to avoid order bias
• Task based testing – which version is more effective & efficient
• What users think – which elements of each design and which version do users prefers and why

Question 45

What are 4 quantitative usability measures?

Answer 45

1. Completion rate - effectiveness & efficiency
2. Time to complete task (don’t use with think-aloud protocol)
3. Error rate (important for safety systems)
4. User satisfaction ratings (post usage)

Question 46

How can you measure effectiveness and efficiency?

Answer 46

Can assess task completion against scale: E, M, H, A (assist), F (fail)

Question 47

How can you measure satisfaction?

Answer 47

Use open questions like: what are 3 things you liked most, what are 3 things you would like to change.
Also use system usability scale, 10 question likert scale, net promotor score (how likely would you be to recommend this to others)

Question 48

How many test participants are recommended?

Answer 48

5 users from each user group will usually find 85% of problems

Question 49

Why should you provide a consent form for test participants?

Answer 49

A consent form helps users to understand how their information will be used and shared

Question 50

How to write good testing tasks?

Answer 50

• Reflect common goals or needs from your personas.
• Include some context.
• Avoid leading users (don’t use words that match system/site)
• Avoid including two tasks in one.
• Avoid the use of slang or culturally specific language.
• Ensure tasks are neutral and won’t offend.
• Write tasks relevant to each user group.
• Allow the user to use their own personal details where practical to do so.
• Keep remote testing tasks short and succinct.
• Don’t tell users how to complete.
• Test tasks should reflect tasks that user groups would do in the real world.
• Each task should have the success criteria defined - what does it mean to say that the task was carried out successfully?

Question 51

What to test in a pilot test?

Answer 51

• Can use co-workers or friends (as you won’t be including their data in your final analysis).
• Test your testing methodology, timing etc. Will you fit everything in you hope to get through?
• Make sure all tasks can be completed (or you know when to stop users if they can’t be completed).
• Ensure users understand the task/scenario wording. You will likely have to tighten up the wording if too vague or loosen up the wording if too leading.
• Analyse test methods and results - are they what you planned.
• Don’t include these results in your final analysis.
• Really important for remote tests as you won’t be there to check their understanding of scenario wording and to ensure everything is working fine.

Question 52

What are the steps in moderating a usability test session?

Answer 52

1. Put participant at ease
2. Obtain informed consent
3. Ask any questions
4. Train participant in thinking aloud
5. Observe behaviour as participant performs tasks
6. Debrief & administer satisfaction survey

Question 53

If a user asks you how to do something in a test, what should you do?

Answer 53

Return the question, asking “how would you expect to do that?”

Question 54

Should you ask ‘why’ during a user test?

Answer 54

No, since we are focusing more on behaviours and users might make up answers to why on the spot

Question 55

What are some traps you could fall into when moderating tests?

Answer 55

• Subconsciously providing feedback or your frustration.
• Defending the design when users provide feedback.
• Not acknowledging participant recommendations.
• Making users feel inferior or stupid.
• Asking leading questions: “Do you like that feature?” Better to ask “How do you feel about that feature?”
• Providing assistance too early – only provide help when the user indicates they would abort.

Question 56

What should you know about recording usability test observations?

Answer 56

• Understand that observations are different to interpretations.
  o An observation is something the participant says or does.
  o Interpretation is an observer’s belief about the cause or an attempt to figure out what they observed.
• Record observations and insights and issues during testing.
• Collaboratively collate and aggregate issues and insights.
• Collaboratively interpret after testing: Top down – bottom up.

Question 57

How to rate usability issue severity?

Answer 57

Severity is a combination of 3 factors:
- frequency with which the problem occurs (common or rare?)
- the impact of the problem if it occurs (easy/difficult to overcome?)
- persistence of the problem (one-time problem? or will users be repeatedly bothered by the problem?)

Question 58

Where can usability testing be conducted?

Answer 58

• Your own office or work environment e.g. a meeting room.
• An internal or external purpose-built usability laboratory.
• In the field in the user’s own environment or where your user group is likely to aggregate e.g. Telstra shop for potential customers.

Question 59

What are the advantages of running usability tests in the field?

Answer 59

• Understand use of the system in the context of their own environment.
• Better reflects how the user will use the system in real life e.g. interruptions.
• Users more comfortable and behaviour more natural.
• Can test user’s own technology.
• Easier to recruit users.
• May capture users in the right mindset doing real tasks that you want them to do online.

Question 60

What are the advantages of running usability tests in a lab?

Answer 60

• More controlled test environment.
• Sessions won’t get interrupted.
• Allows you to unobtrusively video record the session.
• Allows the rest of the project team or managers to easily observe.
• Can schedule more sessions.
• Easier to test systems that are not live.
• Doesn’t require users to install software or screen sharing apps.

Question 61

What are the advantages of running usability tests remotely?

Answer 61

• Can be done 100% online and remotely.
• Get more quantitative data.
• No geographic limitations – test users anywhere.
• Test conducted in the comfort of their own environment – more natural.
• Users using their own technology.
• Usually more cost effective.

Question 62

What are the advantages of the think-aloud protocol and moderated testing?

Answer 62

• Get more qualitative richer data – verbal feedback from users.
• The power of observation - pick up on non-verbal cues.
• Opportunity to ask questions and probe.
• Test interview based natural tasks i.e. ask users questions then get them to perform relevant tasks.
• More flexible test format – e.g. if time permits, ask for additional user feedback or suggestions.
• Users more keen to ‘perform’ and do well – don’t rush through a test just to get incentive.

Question 63

4 different types of usability testing?

Answer 63

• Moderated face-to-face in lab (computer, webcam, mobile)
• Moderated face-to-face in field (paper prototypes, mobile, laptop)
• Moderated remote (phone, screen sharing, Askable)
• Unmoderated remote (Loop11, Treejack, Chalkmark)

Question 64

What are eye tracking gaze patterns?

Answer 64

• Saccade: The movement of the eye from one part of the visual field to another. Fastest movement in the human body.
• Fixation: The pause of an eye movement on a specific area of the visual field.
• Gaze plot: A moment-by-moment representation of a user’s eye movement across the screen.
• Heat map: A representation of the different areas of the screen where the user has spent the most time looking.