week 3

Question 1

survey development process

Answer 1

1. Deciding on topic to research
2. Formulating research question
3. Focus group discussions (if applicable)
4. Literature review (background for items included in questionnaire)
5. Development of scales & subscales to reflect the construct being researched (informed from focus group & literature review)
6. Drafting a tentative set of questions (basis for survey items)
7. Critical review to detect common flaws
8. Putting questions into a survey format
9. Pre-testing using an approximation of proposed data collection procedures
10. Revising survey as required

Question 2

Advantages of Pilot Testing

-

Answer 2

Can provide valuable information about how long it takes respondents to complete the survey.
- Respondents can highlight which questions are unclear, were difficult to answer, were ambiguous, or presented confusing response formats.

Question 3

whats cognitive interviews

Answer 3

• Cognitive interviews provide researchers with a deeper understanding of scale items based on verbal reports of respondents when they describe their thought processes when answering particular questions.

Question 4

whats four questions are cognitive interviews designed to answer

Answer 4

1. Are questions consistently understood?
2. Do respondents have the information needed to answer the questions?
3. Do the answers accurately describe what respondents have to say?
4. Do the answers provide valid measures of what the question is designed to measure?

Question 5

whats the two most common tasks of cognitive interviews

Answer 5

1. To ask respondents to say in their own words what they think the question is asking.
2. To ask respondents to explain how they chose a particular answer over others.

Question 6

conducting mailed surveys

Answer 6

• A maximum of 12 pages is recommended for mail surveys
• Your cover letter should include a brief explanation of the study, an explanation of how you obtained the respondent’s name, why it is important that each “sampled” respondent cooperate, and a short assurance of confidentiality.
• Avoid mailing during holiday periods.

Question 7

questionnaire design steps summary

Answer 7

1. Decide what information is needed.
2. Search for existing questions.
3. Focus groups.
4. Draft new questions/revise existing ones.
5. Sequence the questions. 6. Get peer evaluation.
6. Revise and test on self/co-workers /peers/family membes.
7. Think-aloud interviews.
8. Revise/eliminate questions.
9. Prepare interviewer instructions for pilot test.
10. Pilot test (5-10 cases).
11. Revise eliminate questions based on respondent & interviewer comments.
12. Pilot test again, if necessary.
13. Prepare final interviewer instructions.
14. Be prepared to modify questionnaires if interviewer training raises problems.
15. After interviewing is complete, debrief interviewers for potential problems.
16. Use experience from one study for future planning

Question 8

different tools for literature review (Talbolt and verrinder)

Answer 8

• Using two visual concepts (visual diagrams, the grid and funnel) to explain the techniques and phases in literature management to inform program planning.
• With the funnel diagram, we described their process of writing, using the funnel shape to illustrate the progressive narrowing of the focus of the review and integration of content from the columns.
• drawing up the grid as we described their process of assembling and reading literature

Question 9

whats a synthesis

Answer 9

: is the ability to bring together a variety of facts and concepts into a coherent, clearly written discussion, in order to further our understanding and add to the wider academic discourse.

Question 10

whats a synthesis matrix

Answer 10

: a table in which you can collate the views, ideas, or data according to the themes relevant to answering your research question. Where relevant it is also important to note limitations of the studies, and details regarding their sample size and methodologies, etc.

Question 11

whats description

Answer 11

\: identifies the process, methodology and/or stages. Describes aims and purpose. Reports facts and information
Questions:
-	what?
-	Who?
-	When?
-	Where?
-	How?
-	Why?
Point of view:
-	Neutral position
-	Balanced and unbiased
-	Presents a narrative overview of a situation

Question 12

whats analysis

Answer 12

: Identifies significance and implications to the current study, wider academic discourse, and professional practice. Compares and contrasts information in order to examine connections.
Questions:
- What concepts are important?
- How are they related?
- What tole do different variables play?
- What contributions, strengths or weaknesses are apparents?
- Why should we care?
Point of view:
- Critical
- Expresses evidence based evaluation of the material
- Considers merits and demerits

Question 13

whats IMRad writing structure stand for

Answer 13

Introduction
Method
results
and
Discussion/Conclsion

Question 14

whats summarising

Answer 14

Briefly outlines the main points of a source without adding your ideas or changing the author’s meaning. You should summarise material when providing an overview of the framework, process, or methods, that are relevant to supporting your point.

Question 15

whats paraphrasing

Answer 15

: Expresses information or ideas from other sources in a similar number of words as the source text. You should paraphrase material when you want to cite a concept, but the specific words they have use are not crucial to making your point.

Question 16

whats quoting

Answer 16

Repeats the author’s exact words (but make sure you also discuss the significance and implications of what they have said to fully apply it to your argument!) You should only quote material when the exact wording they have used is essential.

Question 17

how to paraphrase

Answer 17

1. Read the original text several times to fully understand it.
2. Note key concepts, and think about the overall meaning of each part, and begin to put the content in your own words by summarising the main point of each section in a sentence or two.
3. Put the reading aside and state it in your own words without looking at it.
4. Cite your source.
5. Compare your text to the original and check that:
6. The text is in your words
7. You have included the key concepts
8. The meaning has not changed
9. Finally, proofread, revise and edit your paraphrase as necessary.

Question 18

whats narrative/traditional literature review

Answer 18

• critique and summarise a body of literature about a specific topic.
• published materials that provide examination of recent or current literature. Can cover wide range of subjects at various levels of completeness and comprehensiveness. May include research findings.
• The literature is researched from the relevant databases and is generally very selective in the material used.
• The criteria for literature selection for a narrative review is not always made open to the reader. These reviews are very useful in gathering and synthesising the literature located.
• The principle purpose of a narrative review is the give the author and reader a comprehensive overview of the topic and to highlight significant areas of research, narrative reviews can help to identify gaps in the research and help to refine and define research questions

Question 19

whats the weaknesses of narrative/traditional literature review

Answer 19

• A large number of studies may make it difficult to draw conclusions
• The process is subject to bias that supports the researcher’s own work.

Question 20

whats critical review

Answer 20

• Aims to demonstrate writer has extensively researched literature and critically evaluated its quality.
• Goes beyond mere description to include degree of analysis and conceptual innovation.
• Typically results in hypothesis or model.
• Seeks to identify significant items in the field.

Question 21

whats the synthesis approach of critical review

Answer 21

: typically narrative, perhaps conceptual or chronological.

Question 22

whats analysis approach of critical review

Answer 22

significant component: seeks to identify conceptual contribution to embody existing or derive new theory

Question 23

whats a scoping review

Answer 23

• A scoping review is quite similar to a Systematic literature review. The key difference being that there are no restrictions on the materials resourced.
• When undertaking a scoping review it is important to systematise your search strategies to ensure you can replicate your searches and to attend to any gaps that appear in results.
• When reading and sorting the results, again apply some of the measures used in a systematic review so that your search results are sorted by key themes and well organised
• Preliminary assessment of potential size and scope of available research literature.
• Aims to identify nature and extent of research evidence (usually including ongoing research).

Question 24

different approaches for scoping review

Answer 24

• Search approach: Completeness of searching determined by time/scope constraints. May include research in progress.
• Appraisal of articles: No formal quality assessment.
• Synthesis approach used: Typically tabular with some narrative commentary.
• Analysis approach used: Characterises quantity and quality of literature, perhaps by study design and other key features. Attempts to specify a viable review.

Question 25

whats crucially appraised topic (CATs)

Answer 25

• A critically appraised topic (or CAT) is a short summary of evidence on a topic of interest, usually focussed around a clinical question.
• A CAT is like a shorter and less rigorous version of a systematic review, summarising the best available research evidence on a topic.

Question 26

whats integrative review

Answer 26

• A review via a systematic approach that uses a detailed search strategy to find relevant evidence to answer a targeted clinical question.
• Evidence can come from RCTs, observational studies, qualitative research, clinical experts, and other types of evidence.
• Does not use summary statistics.

Question 27

whats a meta analysis

Answer 27

• a quantitative statistical analysis of several separate, but similar experiments or studies in order to test the pooled data for statistical significance.
• technique that statistically combines the results of quantitative studies to provide a more precise effect of the results
• Integrates findings from a large body of quantitative findings to enhance under-standing (study=unit of analysis)
• Draws conclusions and detect patterns and relationships
• Searching the literature: Aims for exhaustive searching. May use funnel plot to assess completeness
• Appraisal of studies: Quality assessment may determine inclusion/exclusion and/or sensitivity analyses.
• Synthesis approach used: Graphical and tabular with narrative commentary.
• Analysis approach used: Numerical analysis of measures of effect assuming absence of heterogeneity.

Question 28

whats a meta synthesis

Answer 28

• Method for integrating or comparing the findings from qualitative studies. It looks for ‘themes’ or ‘constructs’ that lie in or across individual qualitative studies.
• Non-statistical technique
• Integrates, evaluates and interprets findings of multiple qualitative research studies
• Identifies common core elements and themes
• May use findings from phenomenological, grounded theory or ethnographic studies
• Involves analysing and synthesising key elements
• Goal: transform individual findings into new conceptualisations and interpretations
• Search strategy used: May employ selective or purposive sampling.
• Appraisal approach used: Quality assessment typically used to mediate messages not for inclusion/exclusion.
• Synthesis approach used: Qualitative, narrative synthesis.
• ## Analysis approach used: Thematic analysis, may include conceptual models.

Question 29

whats a state of the art review

Answer 29

• Tend to address more current matters in contrast to other combined retrospective and current approaches. May offer new perspectives on issue or point out area for further research.
• Search strategy: Aims for comprehensive searching of current literature.
• Approach to appraisal: No formal quality assessment.
• Approach to synthesis: Typically narrative, may have tabular accompaniment.
• Approach to analysis: Current state of knowledge and priorities for future investigation and research.

Question 30

whats a rapid review

Answer 30

• Assessment of what is already known about a policy or practice issue, by using systematic review methods to search and critically appraise existing research.
• Search strategy: Completeness of searching determined by time constraints.
• Appraisal strategy: Time-limited formal quality assessment.
• Synthesis approach: Typically narrative and tabular.
• Approach to analysis: Quantities of literature and overall quality/direction of effect of literature.