week 4

Question 1

aims of a study

Answer 1

Goal is to collect information that is:

• Valid:
• Reliable:
• Unbiased:
• Discriminating:

Question 2

whats vail

Answer 2

measures the quantity, attribute, attitude or concept that is supposed to be measured

Question 3

whats reliable

Answer 3

measures the quantity, attribute, attitude or concept in a consistent or reproducible manner

Question 4

whats unbaiased

Answer 4

measures the quantity, attribute, attitude or concept in a way that does not systematically under- or overestimate the true value

Question 5

whats discriminating

Answer 5

can distinguish adequately between respondents for whom the underlying level of the quantity, quantity, attribute, attitude or concept or concept is different or varied

Question 6

whats the 6 steps to designing a questionnaire

Answer 6

1. Write out the primary and secondary aims of your study.
2. Write out concepts/information to be collected that relates to these aims.
3. Review the current literature to identify already validated questionnaires that measure your specific area of interest.
4. Compose a draft of your survey questionnaire.
5. Revise the draft of the survey questionnaire.
6. Assemble the final survey questionnaire.

Question 7

whats step 1 define the aims of the study

Answer 7

• Write out the problem and primary and secondary aims using one sentence per aim. Formulate a plan for the statistical analysis of each aim.
• Make sure to define the target population in your aim(s)

Question 8

whats sep 2 degene the variables to be collected

Answer 8

• Write a detailed list of the information to be collected and the concepts or attributes to be measured in the study. Are you trying to identify: • Attitudes • Needs • Behaviour • Demographics • Some combination of these concepts
• Translate these concepts & attributes into variables that can be measured.

Question 9

whats step 3 review the literature

Answer 9

• Review current literature to identify related surveys and data collection instruments that have measured concepts similar to those related to your study’s aims.
• Saves development time and allows for comparison with other studies if used appropriately.
• Proceed with caution if using only a subset of an existing questionnaire as this may change the meaning of the scores. Contact the authors of the questionnaire, scale or instrument to determine if a smaller or shorter version of it exists that has also been validated.

Question 10

whats step 4 compose draft

Answer 10

• Determine the mode of survey administration: face-to-face interviews, telephone interviews, self-completed questionnaires, computer-assisted/web-based approaches.
• Write more questions/items than will be included in the final draft.
• Format the draft as if it were the final version with appropriate white space to get an accurate estimate as to its length – longer questionnaires reduce the response rate.
• Place the most important items in the first half of the questionnaire to increase response on the important measures even in partially completed surveys.
• Make sure questions flow naturally from one to another

Question 11

whats step 5 revise

Answer 11

• Shorten the set of questions for the study. If a question does not address one of your aims, discard it.
• Refine the questions included and their wording by testing them with a variety of respondents.
• Ensure the flow is natural.
• Verify that terms and concepts are familiar and easy to understand for your target audience.
• Keep recall to a minimum and focus on the recent past.

Question 12

whats step 6 assemble the final questionnaire

Answer 12

• Decide whether you will format the questionnaire yourself or use computer-based programs for assistance: • SurveyMonkey.com • Adobe Live Cycle Designer 7.0 • Qualtrics
• At the top, clearly state: • The purpose of the study • How the data will be used • Instructions on how to fill out the questionnaire • Your policy on confidentiality
• Include identifying data on each page of a multi-page, paper-based questionnaire such as a respondent ID number in case the pages separate.
• Group questions/items concerning major subject / topic areas together and introduce them by heading or short descriptive statements.
• Order questions/items in order to stimulate recall.
• Order and format questions/items to ensure unbiased and balanced results.
• Include white space to make answers clear and to help increase response rate.
• Space response scales to items widely enough so that it is easy to circle or check the correct answer without the mark accidentally including the answer above or below. • - - Open-ended questions: the space for the response should be big enough to allow respondents with large handwriting to write comfortably in the space.
• Closed-ended questions: line up answers vertically and precede them with boxes or brackets to check, or by numbers to circle, rather than open blanks.
  Use larger font size (e.g., 12 or 14) and high contrast (black on white

Question 13

how to engage the response rate

Answer 13

• When writing questions and assembling the final questionnaire, edit with a view towards saliency: apparent relevance, importance, and interest of the survey to the respondent
• Consider either pre-notifying those in your sample or sending reminders to those who received the survey (if self-administered). Studies have shown that making contact with the sampled individuals increases the response rate.
• If possible, offer an incentive. Need to be careful with the use of incentives since you do not want it to appear that you are bribing participants or that there is undue ‘inducement’ to take part in the survey

Question 14

whats seven strategies for successful surveys

Answer 14

1. Collect the highest level of data possible
2. Use valid survey instruments
3. Evaluate the reliability of survey instruments
4. Ensure a good response rate
5. Use a random sample
6. Keep meticulous records
7. Keep meticulous records (throughout and keep organised records)

Question 15

advantages / disadvantage mail survey

Answer 15

ad: can be completed at the respondents convinces, no time contstraint
dis: can be time-consuming. many follow up may be require

Question 16

adv/dis. direct survey

Answer 16

adv: take less time, no mailing cost
dis: limits sampling strategies, less flexible in time frame

Question 17

adv/dis online survey

Answer 17

adv: fast, data can be directly imported for analysis
dis: only people with computers can use

Question 18

adv/dis face to face survey

Answer 18

dv: ideal for contacting hard to reach populations, reduces missing dat
dis: cost of travel, longer data collection period

Question 19

aim of in depth interview

Answer 19

According to Taylor (2005, p. 39), ‘the aim of the indepth interview is to explore the “insider perspective,” to capture, in the participants’ own words, their thoughts, perceptions, feelings and experiences’.

Question 20

whats an interview trasnciprt

Answer 20

The written record of an interview that has been transcribed from the verbal conversation. It is used for indepth data analysis in qualitative research.
How should interviews be transcribed? We suggest that each interview is transcribed verbatim (word for word), keeping all the informal conversation style and emotional expressions, such as pauses, emphases, laughter and sighing, and non-lexical sounds like ‘hmm’, ‘oh’, ‘ah’. Importantly, both questions and answers must be transcribed for contextual clarity. What the questions were, how the researchers ask the questions and how the participants answer are all important.

Question 21

range of qualitative data collection methods

Answer 21

• Non-numeric data, commonly in form of words
• Use a single or multiple data collection methods
• Examples of qualitative data collection techniques:
• Field/direct observations with or without participation
• Documents
• Objects e.g. cultural artifacts
• Audio-visual material e.g. photographs
• In-depth interviews e.g. individual or focus group

Question 22

what are in depth interview

Answer 22

• Common qualitative data collection method
• Aims to “explore the “insider perspective,” to capture, in the participants own words, their thoughts, perceptions, feelings and experiences” (Taylor, 2005, p. 35, as cited in Serry & Liamputtong, 2017 p. 68).
• Interviewer & interviewee interact
• Conducted face to face (most common), telephone, video conference

Question 23

limitation of in depth interview

Answer 23

• Generate large amounts of data that require time or costs to conduct and transcribe interviews and analyse data
• Self-report data, thus unable to confirm or disconfirm participants responses

Question 24

three levels of in depth interview

Answer 24

Unstructured (conversational) interview

Semi structured interview: brings structured and unstructured together, some questions are prepared, flexibility in participant to provide response that answers question

Structured/standardised interview: questions are the exact same for participants, not much flexibilty

Question 25

purpose of background/demogrpahic questions

Answer 25

- Focus on participant characteristics e.g. age, gender, education level - Asked as an open question will elicit various responses - Purpose: to understand the people tested and the transferability of results

Question 26

purpose of experience/behaviour questions

Answer 26

- Focuses on what a person does or has done, behaviours, actions experiences or activities e.g. Can you tell me what a typical working week looks like?

Question 27

purpose of opinion/value questions

Answer 27

- Aims to understand what people think about an experience or issue, gaining insight into their opinions, judgements & values - “Tell us about people’s goals, intentions, desires and expectations” (p 444) e.g. What is your opinion of … or What do you think about….?

Question 28

purpose of knowledge questions

Answer 28

- Focuses on understanding people’s factual knowledge e.g. Can you tell me about what services are

Question 29

interview guide needs to qual

Answer 29

- Outlines topics/issues to explore in interview & associated interview questions - Consider question wording & order – define key terms, avoid jargon, & use plain language - Ensure sufficient space under questions to record written information - Use separate interview guide for each participant

Question 30

four areas of an example interview quite qual

Answer 30

1. General information 2. Study introduction 3. Demographic / Background information 4. Interview questions

Question 31

arriving for an interview stage in qual

Answer 31

- Set participant at ease – how will you introduce yourself & build rapport - Explain research purpose, what participants involvement requires & potential benefits of participation - Provide participant with information & consent form to read, if not previously provided. - Allow opportunity to ask questions - Reassure re: confidentially, obtain & sign consent - Request permission to record interview and/or take notes - Inform participant if you will be taking brief notes of key ideas raised during interview to follow up or clarify

Question 32

beginning an interview stage qual

Answer 32

- Use interview (survey) guide to guide interview - Start with easy question first e.g. demographic information - Begin with open questions, use probes to encourage participant to continue talking - Consider own body language and verbal cues

Question 33

ending an interview stage qual

Answer 33

- Summarise key points raised by participant, allows you to check accuracy of your understanding - Indicate to participant that you have no further questions - Invite participant to add anything further or a final comment e.g. Is there anything else that you would like to add?

Question 34

following an interview stage qual

Answer 34

- Thank participant for participation & time - Debrief with participant e.g. ask about experience of interview, refer to support services as needed (should be in research plan) - Provide some feedback on general findings to date - Restate how interview data will be used - Record own researcher reflections on interview

Question 35

Ten interview principles and skills: (Patton)

Answer 35

1. Ask open-ended questions: Invites interviewees to provide thoughtful & in-depth responses on what’s important to them 2. Be clear: Questions must be clear, focused, understandable & answerable 3. Listen: - Listen carefully to participants responses - Show them that you’ve heard them by acknowledging or responding to what they’ve said (verbal & non-verbal cues) 4. Use probes as appropriate: - Use probes to follow up or clarify incomplete responses - Helps guide participants in terms of depth or detail interview requires 5. Observe: Observe body language, helps guide interview interactions & noticing where interview needs to be adapted e.g. participant becomes upset or uncomfortable with topic 6. Be empathetic & neutral: Showing interest in what participants are sharing. Provide non-judgemental encourage or empathy where needed. e.g. I’m interested in hearing about your story, we all have a different story to share, so there is no right or wrong answer 7. Make transitions: Guide the interviewee through the interview process by signposting what is coming next. e.g. So we’ve explored … the next questions we will explore…. 8. Distinguish types of questions: Separate different types of questions helps researchers to be clear of what they are asking and interviewee as to information being requested 9. Be prepared for the unexpected: Important to be flexible with interviews as things can change e.g. amount of time for interview may decrease or increase, interruptions can occur 10. Be present:

Question 36

strategies to strength qual data collection

Answer 36

- Practicing your interview & undertake training in interviewing - Trustworthiness strategies e.g. • Prolonged engagement • Reflexivity • Triangulation • Member checking • Audit trail