week 4 Flashcards

1
Q

aims of a study

A

Goal is to collect information that is:

  • Valid:
  • Reliable:
  • Unbiased:
  • Discriminating:
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

whats vail

A

measures the quantity, attribute, attitude or concept that is supposed to be measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

whats reliable

A

measures the quantity, attribute, attitude or concept in a consistent or reproducible manner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

whats unbaiased

A

measures the quantity, attribute, attitude or concept in a way that does not systematically under- or overestimate the true value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

whats discriminating

A

can distinguish adequately between respondents for whom the underlying level of the quantity, quantity, attribute, attitude or concept or concept is different or varied

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

whats the 6 steps to designing a questionnaire

A
  1. Write out the primary and secondary aims of your study.
  2. Write out concepts/information to be collected that relates to these aims.
  3. Review the current literature to identify already validated questionnaires that measure your specific area of interest.
  4. Compose a draft of your survey questionnaire.
  5. Revise the draft of the survey questionnaire.
  6. Assemble the final survey questionnaire.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

whats step 1 define the aims of the study

A
  • Write out the problem and primary and secondary aims using one sentence per aim. Formulate a plan for the statistical analysis of each aim.
  • Make sure to define the target population in your aim(s)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

whats sep 2 degene the variables to be collected

A
  • Write a detailed list of the information to be collected and the concepts or attributes to be measured in the study. Are you trying to identify: • Attitudes • Needs • Behaviour • Demographics • Some combination of these concepts
  • Translate these concepts & attributes into variables that can be measured.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

whats step 3 review the literature

A
  • Review current literature to identify related surveys and data collection instruments that have measured concepts similar to those related to your study’s aims.
  • Saves development time and allows for comparison with other studies if used appropriately.
  • Proceed with caution if using only a subset of an existing questionnaire as this may change the meaning of the scores. Contact the authors of the questionnaire, scale or instrument to determine if a smaller or shorter version of it exists that has also been validated.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

whats step 4 compose draft

A
  • Determine the mode of survey administration: face-to-face interviews, telephone interviews, self-completed questionnaires, computer-assisted/web-based approaches.
  • Write more questions/items than will be included in the final draft.
  • Format the draft as if it were the final version with appropriate white space to get an accurate estimate as to its length – longer questionnaires reduce the response rate.
  • Place the most important items in the first half of the questionnaire to increase response on the important measures even in partially completed surveys.
  • Make sure questions flow naturally from one to another
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

whats step 5 revise

A
  • Shorten the set of questions for the study. If a question does not address one of your aims, discard it.
  • Refine the questions included and their wording by testing them with a variety of respondents.
  • Ensure the flow is natural.
  • Verify that terms and concepts are familiar and easy to understand for your target audience.
  • Keep recall to a minimum and focus on the recent past.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

whats step 6 assemble the final questionnaire

A
  • Decide whether you will format the questionnaire yourself or use computer-based programs for assistance: • SurveyMonkey.com • Adobe Live Cycle Designer 7.0 • Qualtrics
  • At the top, clearly state: • The purpose of the study • How the data will be used • Instructions on how to fill out the questionnaire • Your policy on confidentiality
  • Include identifying data on each page of a multi-page, paper-based questionnaire such as a respondent ID number in case the pages separate.
  • Group questions/items concerning major subject / topic areas together and introduce them by heading or short descriptive statements.
  • Order questions/items in order to stimulate recall.
  • Order and format questions/items to ensure unbiased and balanced results.
  • Include white space to make answers clear and to help increase response rate.
  • Space response scales to items widely enough so that it is easy to circle or check the correct answer without the mark accidentally including the answer above or below. • - - Open-ended questions: the space for the response should be big enough to allow respondents with large handwriting to write comfortably in the space.
  • Closed-ended questions: line up answers vertically and precede them with boxes or brackets to check, or by numbers to circle, rather than open blanks.
    Use larger font size (e.g., 12 or 14) and high contrast (black on white
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how to engage the response rate

A
  • When writing questions and assembling the final questionnaire, edit with a view towards saliency: apparent relevance, importance, and interest of the survey to the respondent
  • Consider either pre-notifying those in your sample or sending reminders to those who received the survey (if self-administered). Studies have shown that making contact with the sampled individuals increases the response rate.
  • If possible, offer an incentive. Need to be careful with the use of incentives since you do not want it to appear that you are bribing participants or that there is undue ‘inducement’ to take part in the survey
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

whats seven strategies for successful surveys

A
  1. Collect the highest level of data possible
  2. Use valid survey instruments
  3. Evaluate the reliability of survey instruments
  4. Ensure a good response rate
  5. Use a random sample
  6. Keep meticulous records
  7. Keep meticulous records (throughout and keep organised records)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

advantages / disadvantage mail survey

A

ad: can be completed at the respondents convinces, no time contstraint
dis: can be time-consuming. many follow up may be require

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

adv/dis. direct survey

A

adv: take less time, no mailing cost
dis: limits sampling strategies, less flexible in time frame

17
Q

adv/dis online survey

A

adv: fast, data can be directly imported for analysis
dis: only people with computers can use

18
Q

adv/dis face to face survey

A

dv: ideal for contacting hard to reach populations, reduces missing dat
dis: cost of travel, longer data collection period

19
Q

aim of in depth interview

A

According to Taylor (2005, p. 39), ‘the aim of the indepth interview is to explore the “insider perspective,” to capture, in the participants’ own words, their thoughts, perceptions, feelings and experiences’.

20
Q

whats an interview trasnciprt

A

The written record of an interview that has been transcribed from the verbal conversation. It is used for indepth data analysis in qualitative research.
How should interviews be transcribed? We suggest that each interview is transcribed verbatim (word for word), keeping all the informal conversation style and emotional expressions, such as pauses, emphases, laughter and sighing, and non-lexical sounds like ‘hmm’, ‘oh’, ‘ah’. Importantly, both questions and answers must be transcribed for contextual clarity. What the questions were, how the researchers ask the questions and how the participants answer are all important.

21
Q

range of qualitative data collection methods

A
  • Non-numeric data, commonly in form of words
  • Use a single or multiple data collection methods
  • Examples of qualitative data collection techniques:
  • Field/direct observations with or without participation
  • Documents
  • Objects e.g. cultural artifacts
  • Audio-visual material e.g. photographs
  • In-depth interviews e.g. individual or focus group
22
Q

what are in depth interview

A
  • Common qualitative data collection method
  • Aims to “explore the “insider perspective,” to capture, in the participants own words, their thoughts, perceptions, feelings and experiences” (Taylor, 2005, p. 35, as cited in Serry & Liamputtong, 2017 p. 68).
  • Interviewer & interviewee interact
  • Conducted face to face (most common), telephone, video conference
23
Q

limitation of in depth interview

A
  • Generate large amounts of data that require time or costs to conduct and transcribe interviews and analyse data
  • Self-report data, thus unable to confirm or disconfirm participants responses
24
Q

three levels of in depth interview

A

Unstructured (conversational) interview

Semi structured interview: brings structured and unstructured together, some questions are prepared, flexibility in participant to provide response that answers question

Structured/standardised interview: questions are the exact same for participants, not much flexibilty

25
Q

purpose of background/demogrpahic questions

A
  • Focus on participant characteristics e.g. age, gender, education level
  • Asked as an open question will elicit various responses
  • Purpose: to understand the people tested and the transferability of results
26
Q

purpose of experience/behaviour questions

A
  • Focuses on what a person does or has done, behaviours, actions experiences or activities e.g. Can you tell me what a typical working week looks like?
27
Q

purpose of opinion/value questions

A
  • Aims to understand what people think about an experience or issue, gaining insight into their opinions, judgements & values
  • “Tell us about people’s goals, intentions, desires and expectations” (p 444) e.g. What is your opinion of … or What do you think about….?
28
Q

purpose of knowledge questions

A
  • Focuses on understanding people’s factual knowledge e.g. Can you tell me about what services are
29
Q

interview guide needs to qual

A
  • Outlines topics/issues to explore in interview & associated interview questions
  • Consider question wording & order – define key terms, avoid jargon, & use plain language
  • Ensure sufficient space under questions to record written information
  • Use separate interview guide for each participant
30
Q

four areas of an example interview quite qual

A
  1. General information
  2. Study introduction
  3. Demographic / Background information
  4. Interview questions
31
Q

arriving for an interview stage in qual

A
  • Set participant at ease – how will you introduce yourself & build rapport
  • Explain research purpose, what participants involvement requires & potential benefits of participation
  • Provide participant with information & consent form to read, if not previously provided.
  • Allow opportunity to ask questions
  • Reassure re: confidentially, obtain & sign consent
  • Request permission to record interview and/or take notes
  • Inform participant if you will be taking brief notes of key ideas raised during interview to follow up or clarify
32
Q

beginning an interview stage qual

A
  • Use interview (survey) guide to guide interview
  • Start with easy question first e.g. demographic information
  • Begin with open questions, use probes to encourage participant to continue talking
  • Consider own body language and verbal cues
33
Q

ending an interview stage qual

A
  • Summarise key points raised by participant, allows you to check accuracy of your understanding
  • Indicate to participant that you have no further questions
  • Invite participant to add anything further or a final comment e.g. Is there anything else that you would like to add?
34
Q

following an interview stage qual

A
  • Thank participant for participation & time
  • Debrief with participant e.g. ask about experience of interview, refer to support services as needed (should be in research plan)
  • Provide some feedback on general findings to date
  • Restate how interview data will be used
  • Record own researcher reflections on interview
35
Q

Ten interview principles and skills: (Patton)

A
  1. Ask open-ended questions: Invites interviewees to provide thoughtful & in-depth responses on what’s important to them
  2. Be clear: Questions must be clear, focused, understandable & answerable
  3. Listen:
    - Listen carefully to participants responses
    - Show them that you’ve heard them by acknowledging or responding to what they’ve said (verbal & non-verbal cues)
  4. Use probes as appropriate:
    - Use probes to follow up or clarify incomplete responses
    - Helps guide participants in terms of depth or detail interview requires
  5. Observe: Observe body language, helps guide interview interactions & noticing where interview needs to be adapted e.g. participant becomes upset or uncomfortable with topic
  6. Be empathetic & neutral: Showing interest in what participants are sharing. Provide non-judgemental encourage or empathy where needed. e.g. I’m interested in hearing about your story, we all have a different story to share, so there is no right or wrong answer
  7. Make transitions: Guide the interviewee through the interview process by signposting what is coming next. e.g. So we’ve explored … the next questions we will explore….
  8. Distinguish types of questions: Separate different types of questions helps researchers to be clear of what they are asking and interviewee as to information being requested
  9. Be prepared for the unexpected: Important to be flexible with interviews as things can change e.g. amount of time for interview may decrease or increase, interruptions can occur
  10. Be present:
36
Q

strategies to strength qual data collection

A
  • Practicing your interview & undertake training in interviewing
  • Trustworthiness strategies e.g. • Prolonged engagement • Reflexivity • Triangulation • Member checking • Audit trail