chatgpt mess

Question 1

What is the Build-Measure-Learn cycle in user research?

Answer 1

It’s an iterative process from Lean UX. Build a minimal product, measure how it’s used (telemetry, surveys), and learn from the data to refine the design.

Question 2

What are the key benefits of hypothesis-driven design?

Answer 2

It ensures your design decisions are testable and grounded in expected outcomes, enabling iterative improvement through experiments.

Question 3

What’s the difference between quantitative and qualitative methods?

Answer 3

Quantitative methods collect numeric data (e.g., surveys, telemetry); qualitative methods explore experience and reasoning (e.g., interviews, think-alouds).

Question 4

When would you use a within-groups study design?

Answer 4

When all participants are exposed to all conditions. It reduces variability due to participant differences but may suffer from carryover effects.

Question 5

What is operationalisation in research?

Answer 5

It’s the process of turning theoretical constructs (e.g., ‘fun’) into measurable variables (e.g., time spent in game, survey scores).

Question 6

What are the advantages of telemetry data in games research?

Answer 6

It offers unobtrusive, scalable, and detailed behavioral data. However, it requires careful design and interpretation to link behavior to experience.

Question 7

What should be avoided in survey design?

Answer 7

Avoid double-barreled questions, complex or confusing wording, and biasing language. Ensure questions are clear, specific, and not leading.

Question 8

What is the five-number summary in statistics?

Answer 8

Minimum, Q1, Median (Q2), Q3, Maximum. It provides a robust summary of distribution, especially useful for skewed data.

Question 9

What is GSR and when is it used?

Answer 9

Galvanic Skin Response measures physiological arousal. Used in psychophysiology to assess emotional or stress reactions during gameplay.

Question 10

Why is validity important in research?

Answer 10

Validity ensures you’re measuring what you intend to. Without it, results may be unreliable or meaningless despite being consistent.

Question 11

What is Hypothesis formulation?

Answer 11

are about comparison (e.g., comparing di ! erent builds, di ! erent games of the same genre, etc) - Hypothesis formulation requires knowing what data you want to collect Ñ but that is also helpful for all research questions RESE ARCH QUESTION VS HYPOTHESIS STUDY DESIGN: WHAT DATA TO COLLECT AND WHY? - The function of a study design is that the data collected helps us answer the research questions as unambiguously and precisely as possible - E.g., does this new UI allow players to make decisions faster? Do players und

Question 12

What is Stakeholders?

Answer 12

d cons, what theyÕre good for É helps you make better decisions and justify your decisions to other stakeholders WHY BOTHER WITH THE INFO DUMP? WHAT IS GAMES USER RESE ARCH ? - Games user research (GUR) supports game development by understanding players - GUR draws from psychology, data science, human factors and ergonomics, UX, interaction design, computer science, and many other Þ elds ONCE UPON A TIME IN SUNNY VALE , CALIFORNIA http://www.atarimania.com/mags/pdf/atari-coin-connection-vol-03-num-08.pdf ON

Question 13

What is Research methods?

Answer 13

servation - Quantitative Testing: March 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluate your games - Understanding di ! erent characteristics of games user research methods, their pros and cons, what theyÕre good for É helps you make better decis

Question 14

What is Quantitative vs Qualitative?

Answer 14

chael C. Medlock. 2018. An Overview of GUR Methods. In Games User Research. Oxford University Press QUANTITATIVE VS QUALITATIVE METHODS Quantitative - Collect numerical information, e.g., how much? how often? - Aims at generalization across the population out of which the representative sample was drawn - Typically requires large sample size (i.e., lots of testers) Qualitative - Collect descriptive information, e.g., how did this happen? why did you do this? - The data obtained is thick and rich, and its analysis is about

Question 15

What is Research question?

Answer 15

h 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluate your games - Understanding di ! erent characteristics of games user research methods, their pros and cons, what theyÕre good for É helps you make better decisions and justify your decisions to othe

Question 16

What is Observation?

Answer 16

D STRUCTURE - Two testing cycles - Qualitative Playtesting: Feb 6 (today!) - March 6 - Interviews - Observation - Quantitative Testing: March 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluate your games - Understanding di ! erent characteristi

Question 17

What is Interview?

Answer 17

VELOPMENT DDDD STRUCTURE - Two testing cycles - Qualitative Playtesting: Feb 6 (today!) - March 6 - Interviews - Observation - Quantitative Testing: March 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluate your games - Understanding di ! eren

Question 18

What is Playtesting?

Answer 18

i o n s DATA- D R I V E N DESIGN AND DEVELOPMENT DDDD STRUCTURE - Two testing cycles - Qualitative Playtesting: Feb 6 (today!) - March 6 - Interviews - Observation - Quantitative Testing: March 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluat

Question 19

What is Think-aloud?

Answer 19

ys - A/B Testing - Playtesting - A very brief introduction to Qualitative Methods - Observation and Think-Aloud - Interviews TO DAY Õ S L EC T U R E PL AY TESTING ó eÙ U+ X \ :e e } Ù –:j 22 \ :Ù X æ e :Ù –:j e 2’ \ Ù–:j X X:+ 2 Ù –:j X e 1æ + 2 \à Ù 2\ e \æ 2 2Ù X 12à Ù’ 2 1 \à Q O Q S - ÒPlaytesting can be one of the most exhilarating parts of the game development cycle.Ó (Rouse 2001) - ÒI hate playtesting…It

Question 20

What is Coding?

Answer 20

testing for March 3 NE XT WEEK FEB 27: SUPERVISION MEETINGS QUESTIONS ABOUT L A ST WEEKÕS TOPICS? - Coding - A ! nity Diagramming - Guest Lecture Mike Hyslop Graham TO DAY Õ S L EC T U R E - Admittedly, this is a pretty dry topic - Plus people sometimes underestimate qualitative analysis or think itÕs ÒeasyÓ because it usually doesnÕt involve statistics - But knowing how to analyze qualitative data e “ ectively and e ! ciently is a useful skill - If you do interviews or observations for your master th

Question 21

What is Video-Elicited Interviews?

Answer 21

involved qualitative analysis approach (e.g., Thematic Analysis) TL ;DR 15 MINUTES BRE AK ANALYZING VIDEO-ELICITED INTERVIEWS GROUPWORK:PILOTYOURPL AYTEST Pilot your playtest and collect qualitative data ¥ Assign roles within your group: Playtester, playtesting host, interviewer, observer, note-taker ¥ There can be multiple observers and note-takers ¥ Some roles can be combined, e.g., host and interviewer; observer and note-taker ¥ After first playtest: Review your data. ¥ Did you miss something crucial? ¥ What went wel

Question 22

What is Operationalisation?

Answer 22

mportant PL AYER E XPERIENCE NE A SURING PL AYER E XPERIENCE Frustration=5 Engagement=2 Control=1 - Operationalisation - From construct to operational de Þ nitions (variables, metrics, KPIs) - Operational de Þ nitions: - Precise - Objective PSYCHOMETRICS PLAYER ENGAGEMENT (PE) 5-QUESTION SURVEY ASKING ABOUT PE Construct Operational De Þ nition Operationalisation Operational de Þ nition score = Construct score + error CL A S SICAL TEST THEORY Operational de Þ nition score = Construct score + error CL A S SICAL TES

Question 23

What is Construct?

Answer 23

question RESE ARCH QUESTIONS TURN INTO DATA A S SES SMENT - Operationalization: Turning an abstract construct into information you can capture - For example, di ! culty (abstract concept) - Possible information that captures di ! culty - How often players die and how long they take to complete each challenge - Data about when and how players failed - Players think the game is challenging OPER ATIONALIZ ATION - ÒIs the tutorial e ! ective?Ó - Observation: - Expressions of confusion from the player - Mista

Question 24

What is Reliability?

Answer 24

e di ! erent criteria - In the lecture on Quantitative Methods (13/3), we will discuss validity and reliability TO DAY W E FO C U S O N P R O C E S S Fi n a l l y, q u a l i t a t i v e r e s e a r c h i s a d i v e r s e Þ e l d within which a variety of epistemological and ontological (what we can know and how we knowit)standpointsarerepresentedsuggesting incompatibility with Þxed, universal procedures and standards (Yardley, 2000). This has often meant that even within qualitative research, the means of

Question 25

What is Validity?

Answer 25

ethods require di ! erent criteria - In the lecture on Quantitative Methods (13/3), we will discuss validity and reliability TO DAY W E FO C U S O N P R O C E S S Fi n a l l y, q u a l i t a t i v e r e s e a r c h i s a d i v e r s e Þ e l d within which a variety of epistemological and ontological (what we can know and how we knowit)standpointsarerepresentedsuggesting incompatibility with Þxed, universal procedures and standards (Yardley, 2000). This has often meant that even within qualitative resear

Question 26

What is Telemetry?

Answer 26

ing: Feb 6 (today!) - March 6 - Interviews - Observation - Quantitative Testing: March 13 - May 8 - Telemetry - Surveys - A/B Testing - Games User Research Methods - How to formulate a research question - Research study design TO DAY Õ S L EC T U R E - It will be covered in the exam :P - More importantly: In your own projects, thesis work, future job, etc É you will have to decide how to best evaluate your games - Understanding di ! erent characteristics of games user research methods, their pros and con

Question 27

What is Types of questions?

Answer 27

telemetry SOME GENER AL RULES OF THUMB - ÒHow often do players use the sniper ri ß e?Ó Avoid these types of questions - Questions with no actionable Þ ndings - Questions likely to produce ambiguous answers - Sometimes useful (trust your intuition), but resources are Þ nite RESE ARCH QUESTIONS TO AVOID Instead of: - ÒHow often do players use the sniper ri ß e?Ó Ask: - ÒHow often do sniper ri ß es win matchups against other weapons?Ó Or: - ÒHow often are sniper ri ß es used in unfavourable matchups?" BE SPECIFIC -

Question 28

What is Sampling?

Answer 28

e key headings of researcher epistemological and theoretical stance, process and analysis (methods, sampling, data collection, analysis) and results and conclusions (applicability). Step-by-step guide through the framework Th e c h a r t i s p r e s e n t e d i n i t i a l l y i n i t s e n t i r e t y a n d then broken down for further description at each step. Researcher epistemological and theoretical stance Goodqualityresearchensuresthattheepistemo- logical and theoretical stance of the researcher i

Question 29

What is Five-Number Summary?

Answer 29

0-Quantiles (percentiles) RANGEANDQUANTILES - No single measure is enough to describe skewed data - Five-number summary: - Minimum value or Q1-1.5*(Q3-Q1) - Q1 - Median (Q2) - Q3 - Maximum value or Q3+1.5*(Q3- Q1) FIVE-NUMBER SUMMARY - Calculate the Þ ve-number summary EXERCISE Re c o r d e d j u m p s 217 cm 219 cm 226 cm 170 cm 200 cm 180 cm 204 cm 168 cm 203 cm 165 cm 177 cm 195 cm 230 cm 161 cm 194 cm 215 cm 241 cm 219 cm 206 cm 189 cm 175 cm 195 cm 223 cm 214 cm 194 cm 222 cm 209 cm 209 cm 202 cm 203 cm FIVE

Question 30

What is Variance?

Answer 30

he samples should be normally distributed (visual inspection) - The samples should have the similar variance - Paired vs unpaired - One-tailed vs two-tailed T-TESTCONDITIONSANDTYPES - Take the date from Table 2.1 on page 55 of the readings - Type the data in google sheets - Perform a two-sample t-test (not paired) - Take the data from Table 3.1 on page 77 of the readings - Type the data in google sheets - Perform a paired two-sample t-test T-T E S T E X E R C I S E CHI-SQUARE TEST - Comparing two succes

Question 31

What is Visualisations?

Answer 31

Number of unique users completing a level - Events to collect: - Level started - Level completed - Visualisations: Bar Chart, Stacked Bar Chart PL AYERKPIANDNECESSARYDATA-EXAMPLE1/2 - KPI: Event frequency - Number event per position/area - Events Collected - Item collected - Death - Click on screen - Fixation - Visualisation: Heat Map PL AYERKPIANDNECESSARYDATA-EXAMPLE2/2 Split into groups Break down the gameplay/interaction following the categories we just discussed to identify what could be tracked Which o

Question 32

What is Histogram?

Answer 32

9,2 9,3 10,1 9,5 10 9,6 -1,5 16 19 15,1 13 2,6 9,0 7,2 9,6 10 9,6 Mean Median - Visualised using a Histogram - Frequency of di ! erent values - Requires binning (value "buckets") DISTRIBUTION - Range Di ! erence between largest and smallest value - Quantiles Divide sorted data into equal- sized sets - 4-Quantiles (quartiles) Interquartile range, IQR = Q3 # Q1 - 100-Quantiles (percentiles) RANGEANDQUANTILES - No single measure is enough to describe skewed data - Five-number summary: - Minimum value or Q1

Question 33

What is Hypothesis testing?

Answer 33

WRONG QUESTION - Are we measuring always the same thing? - Are we measuring the construct? - Is our hypothesis testing our theory? OPER ATIONALISATION CORE QUESTIONS - Aka Reliability - Repeated measures of the same thing give the same result - Types of reliability: - Test re-test reliability - Inter-rater reliability - Internal consistency ARE WE ME A SURING ALWAYS THE SAME THING? Test-retest Reliability? Inter-rater Reliability? Internal Consistency? - Aka Validity - Reliability is necessary but no su ! cient f

Question 34

What is Null hypothesis?

Answer 34

! erence between the two samples - H1: There is a signi Þ cant di ! erence between the two samples NULL HYPOTHESIS - H0: There is no signi Þ cant di ! erence between the two samples - H1: There is a signi Þ cant di ! erence between the two samples NULL HYPOTHESIS WE WANT TO DISPROVE THIS T-TEST - Comparing two means (numeric dependent variable) - Find out what is the probability that the null hypothesis is true - The smaller the probability, the less evidence we have to support the null hypothesis - Below a c

Question 35

What is T-test?

Answer 35

here is a signi Þ cant di ! erence between the two samples NULL HYPOTHESIS WE WANT TO DISPROVE THIS T-TEST - Comparing two means (numeric dependent variable) - Find out what is the probability that the null hypothesis is true - The smaller the probability, the less evidence we have to support the null hypothesis - Below a certain probability threshold (p<0.05) we deem the risk to be small enough to reject the null hypothesis - We seek to reject the null hypothesis to support our initial hypothesis T-T

Question 36

What is Researcher bias?

Answer 36

can help generate new insights - An audio record provides a full account for later reference Cons - Researcher bias is not always obvious - Can be di " cult to prepare and run without experience - Considered less rigorous or valid than quantitative data by some (they are wrong, but they might still think it) - A researcher observes a tester's play behavior while taking notes - Ideally, a second researcher facilitates the session, and the observer is elsewhere (e.g., watching on a separate screen) OBSERVATION P

Question 37

What is a Research Question in the context of game studies?

Answer 37

A research question defines the issue to be analyzed, typically focusing on properties, changes, relationships, or external impacts. It must require actual research to be answered.

Question 38

What are Constructs in user research?

Answer 38

Constructs are unmeasurable and subjective properties of the game or play experience, such as enjoyment or difficulty. They require proxy measurements to study.

Question 39

What is Operationalization?

Answer 39

Operationalization is the process of measuring a construct through proxies like survey answers or observed behaviors (e.g., using eye-tracking to measure attention).

Question 40

What is Reliability in research measurement?

Answer 40

Reliability ensures that repeated measurements yield consistent results. Types include test-retest, inter-rater, and intra-rater reliability.

Question 41

What is Validity in research?

Answer 41

Validity determines whether a test measures what it is supposed to. It is supported by evidence from test content, response process, internal structure, and nomological nets.

Question 42

What is the difference between Dependent and Independent Variables?

Answer 42

The independent variable is controlled by the researcher (e.g., eating breakfast), while the dependent variable changes based on the independent variable (e.g., exam results).

Question 43

What is the difference between Between-Subjects and Within-Subjects designs?

Answer 43

Between-subjects compares different participant groups across conditions, while within-subjects uses the same participants tested before and after an intervention.

Question 44

What are different types of Sampling in research?

Answer 44

Types include probability (e.g. stratified), non-probability (e.g. convenience, purposive), snowball, extreme, typical case, and deviant case sampling.

Question 45

What are good practices for survey question design?

Answer 45

Avoid assumptions, complexity, length, sensitive wording, leading questions, double negatives, and adjacent identical scales. Ensure clarity and neutrality.

Question 46

What is a Bangs Test in user research?

Answer 46

Bangs testing is not standard nomenclature in academic literature, but likely refers to impact-focused usability/playtest techniques (e.g. first impression, major failure points). Confirm with instructor if necessary.

Question 47

Why would you choose interviews over other qualitative methods like think-aloud protocols?

Answer 47

Interviews allow for deeper exploration of participants' thoughts, feelings, and reasoning. They are flexible and adaptive, whereas think-aloud methods focus more on in-the-moment actions and are less introspective.

Question 48

How do you analyze qualitative interview data?

Answer 48

Common methods include coding (assigning labels to data segments), thematic analysis (identifying themes across the data), and affinity diagramming (organizing codes to find patterns).

Question 49

Explain like I'm 5: What is a p-value and why do we need it?

Answer 49

A p-value tells us how likely it is that what we observed happened just by chance. If it's really small (usually less than 0.05), we say it probably didn’t happen by accident, so our idea might be right!

Question 50

What is PXI?

Answer 50

The Player Experience Inventory (PXI) is a psychometric tool designed to measure different dimensions of player experience, including immersion, mastery, autonomy, and enjoyment.

Question 51

What is BANGS?

Answer 51

BANGS is a set of constructs used in game UX research, focusing on core aspects of game experience like Behavioral Involvement, Affective responses, Narrative engagement, Game mechanics understanding, and Social presence.

Question 52

Why would you mix constructs from BANGS and PXI?

Answer 52

Mixing constructs from BANGS and PXI allows researchers to tailor their questionnaire to better match the experience goals of the game, combining dimensions that capture different aspects of player experience.

Question 53

Why and how would you modify items from the PXI?

Answer 53

Modifications might be necessary to fit specific game contexts or player demographics. Items can be reworded or replaced to maintain validity while ensuring relevance and clarity for participants.