Methodology Flashcards

1
Q

What is our research philosophy?

A

Pragmatism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What defines pragmatism?

A
  • Complex world, multiple realities (vi kan ikke aflægge dem alle og det er derfor “up for interpretation and for the view we have”). No single point of view will give the full picture of these multiple realities.
  • Pragmatism perceive concepts, theories, and knowledge in which they enable action, and our research are thus centered around operational practices, their relevance to successful actions, and problem solving
  • Want to impact future practices
  • The view is aware that researchers impact the research but is a balance of both objectivism and subjectivism
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is our research approach?

A

Abductive approach

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the abductive method?

A
  • The abductive approach is characterized by the researchers moving between theory and data continuously and, thus, combining deduction and induction. Throughout we conducted comparisons and interpretations based on the generated data and the relevant theory.
  • Lack of missing literature I R&ED/pharma. Leverage what is there (literature to theory/hypothesis (deductive)), but the missing link makes the need for understanding through induction (data to theory) and building on that.
  • Ideally we would test the framework once we were “done”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the method used in this research of the thesis? And why is it good?

A

Semi-structured interviews, quantitative and qualitative secondary data. Most focus on qualitative data and semi-structured interviews.

Concurrent mixed method - enabling us to analyze the phenomenon from several points of view in line with our pragmatism standpoint.

  • Allows for quantitative and qualitative data, again fitting well with pragmatism as several perspectives are explored. Enables triangulation.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the research strategy?

A

Single Embedded Case Study.

  • Access, open-office seating (casual interactions also with other departments), informal 2:1’s, monthly and weekly department meetings (incl. pWr meeting) - helped build rapport and overcome trust and any potential cognitive restrictions.
  • Meant Novo Nordisk helped shape the study.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the time horizon of the study?

A

Cross-sectional, i.e. a snapshot in time, meaning the findings/situation can change over time.

  • Chosen for several reasons: 16-week internship (drug development and bureaucratic nature makes it non-viable to do a longitudinal study)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the techniques and procedures used in this thesis?

A

1) Data collection (primary data: semi-structured interviews & secondary data: unstructured observations/meetings, documents, 2:1s, open-office interactions, and pWr )
2) Data analysis (Template analysis i.e., coding) AND desifn principles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What could alternative time horizons be?

A

Longitudinal, i.e. across time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is our sampling technique in the interviews? How did you select interviewees?

A

Heterogeneous purposive non-probability sampling method.

  • Chosen non probabilistic, with purpose based on judgment and information. Heteregenous because we select different roles that can enlighten the multiple realities and help us form a whole image for our pragamatic solution.
  • 4 themes to cover the needed data.
  • Participants are chosen based on seniority (and thus knowledge of the area) and availability.
  • External PPM consultant + GRT: Opportunistic purposive sampling
  • Small sample size in scope for the research requires an informed and judgmental sampling process to ensure the problem is adequately illuminated.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the main bias we should be aware of?

A

Interview bias:
1) Response bias: If the participants are willing to share and be honest.
Mitigation: Anonymity, rapport, and confidentiality (i.e., embedment ensures this is not an issue)), embedment also ensures competency of the interviewers to understand the context and ask for clarification when needed.

2) Interviewer bias: Do we impact the answers through behaviour, questioning or beliefs? Our opinions and biases impact the results, also inherently the embedment in R&ED P&A makes us biased towards PPM.
Mitigation: Interview guides, open-ended questions, two people to question potential bias from each other.

3) Participant bias: Their bias in relation to their role in the company.
Mitigation: Secondary data, exposing the bias made in the thesis makes us aware and easier to understand the bias and its impact + triangulation. Provided codes for readers to be aware of these when reading the analysis.

Selection/sampling bias:
4) Sampling bias/selection bias: Purposive and judgemental, i.e. we tried to choose relevant parties, but utilized opportunistic purposive sampling when this arose from interviews.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why does our research strategy make sense?

A

Single embedded case study:
- Embedment ensures research quality as: Understand context, overcome confidentiality, access to data and people (triangulation), enables thorough understanding of case company.
- When no clear litterature is there, it makes sense to understand the practices from within. (Hard to understand otherwise).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is primary data?

A

Data collected specifically for the research question.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is secondary data, and its role in this study?

A
  • Data collected for another purpose than the specific research question.
  • Purpose: Support interviews and use for triangulation to inform on more perspectives.
  • Observations could be argued for as primary data, however, observational situations were for another purpose than our specific research question, like department meetings etc. + We haven’t done systematic collection of observations like transcripts and systematic notes, thus secondary data seems fitting. –> Could be better documented next time and 2:1 meetings could be recorded
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How did you handle/analyze data?

A
  • Template analysis through the 6 steps described within.
  • Both corrected around half of the automated transcripts and coded the interviews together.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are design principles and what did you do with these?

A
  • Extrapolated generalizable design principles from each part of the analysis for use in a generalizable framework.
  • Improves generalizability as they are on are more high-level plan and non-case specific.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What factors affect the quality of the research?

A
  • Validity (Credibility and Transferability) and Reliability (Dependability in qualitative research)
  • Dependability: Creating transparent research, so it may be understood and evaluated by others. Documented the process to make it clear to other researchers what has happened throughout.
  • Credibility (Do we understand the interviews and data): Rapport and honesty (through embedment, anonymity). Joint research with two researchers has increased the understanding. Embedment and theory have made us competent in understanding the topic of PPM, strategy, and decision-making.
  • Transferability (Findings generalizability): Triangulation, Novo is similar to other originator companies (but it should be assessed if they have similar size, PPM capabilities etc. if implementing the framework and the findings).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Why is it important to consider research philosophy?

A

The research philosophy (beliefs and assumptions about reality and the development of knowledge) affects the view of the world and thus shapes the research conducted.

  • Thus, when conducting research, every stage of the research process will be affected by the researchers’ assumptions about reality, knowledge, and the extent to which their own values influence the research process.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Name a concrete example of moving back and forth from theory and data

A

1) The entire framework. Step 4 specifically was an iterative process with a starting point from litterature, then gathering data and feedback, going back to litterature and then final feedback from interviewees.

2) Problem identified for the study: the initial problem identification based on both inductive observations and deductive theoretical extrapolations, followed by data generation and analysis, leveraging themes and questions influenced directly by existing literature and by the findings through continuous iteration.

19
Q

Why is the abductive approach good in this case?

A

1) Creates a well-rounded study by accessing several perspectives.
2) PPM and strategy is well described. However not in the case of R&ED. Makes sense to utilize the existing theory and add to it in this field that is not very well described.

20
Q

Case studies are often viewed as? And why is it wrong?

A
  • Viewed as having a low degree of generalizability and reliability.

However, this has been disputed in several works, partly by the use and growing value of mixed methods research (Flyvbjerg, 2011; Saunders et al., 2021) as applied in this study.

21
Q

Describe the semi-structured interview approach and its strenghts

A
  • Researchers guided by a pre-made list of questions and themes, can diverge to gain a better understanding of topics if deemed relevant.
  • Ensures focus and flexibility and thus depth.
  • Open-ended (non-leading) questions based on an abductive approach.
  • Tailored to the interviewees as they were experts in different fields and should give insights to these for the research using multiple points of views.
  • Duplicates ensured reliability of the findings somewhat.
22
Q

Describe the inductive approach?

A

Theory generation and building.

Case/data –> Literature/theory (i.e. from specific to general - a white swan –> all swans are white)

Reality forms a generalisation/theory.

“1”-ductive (1 svane er hvid må betyde de alle er det)

23
Q

Describe the deductive approach?

A

Theory falsification or verification

From general to the specific. (All swans are white, ergo this swan must be white. Reject or confirm if the swan is indeed whit then)

Theory predicts reality.

“Min hypothese er at alle svaner er hvide, lad os indsamle data og se om det passer”

24
Q

Why could dividing a small sample size (10 participants) into smaller categorizes appear as a weakness of the research design?

A
  • Less confirmation of facts, however, more perspectives are illuminated (and we like that)
  • Patton et al., 2015 - likely to reveal patterns of high interest and value within the selected themes –> thus deemed appropriate for this qualitative part of the study (Patton, 2015).
25
Q

Describe the interview process

A

10 in total ranging from 30-90 minutes.

1) Before interviews, invitation and casual talks when possible to build trust and rapport.
2) Introduction (inform and “get them talking”) make the mfeel safe.
3) Two-layered open-ended neutral questions: Main and sub (in case they needed iteration on the answer)
4) Grand tour questions “easy questions”
5) Outro: People of interest (added after interview 5) and last comments

26
Q

Describe roles in the interview:

A

1) Interviewer - Keep on track with questions and time
2) Follow up and ensure depth when needed.

27
Q

What is research reliability? What is it in qualitative research?

A

Consistency in the research, results, and replicability. If the research design is replicable and others can achieve the same results, then the study is deemed reliable.

  • However, qualitative research is not necessarily designed to be replicated, although methodological rigor will increase other’s ability to replicate the study

Qual: Dependability

28
Q

How have you worked to increase dependability of the research?

A

1) Thoroughly described the research process and methodology including any changes made in our approach, e.g., the opportunistic purposive sampling
2) Provided transcripts of our semi-structured interviews –> fully transparent

29
Q

What is research Validity? What is it in qualitative research?

A
  • Are the appropriate measures used?
  • Accuracy of the analysis
  • Generalizability of the findings

Qual: Credibility & Transferability

30
Q

What is the credibility of the study? How have you increased this?

A
  • The researchers’ ability to understand the research participants’ intended meanings

1) Jointly conducted research, prompting continuous reflection and interpretation of observations and findings
2) Embedment + anonymity (interviewees can share honest opinions and views)

31
Q

What is transferability of the study? How have you increased this?

A
  • How well the study is made applicable to other contexts or other researchers through transparency of the study procedures
  • Transparency and thorough methodological descriptions make researchers able to gauge where and when this research is applicable.
  • Not as generalizable as deductive quantitative studies
32
Q

Describe the data analysis

A

Template analysis.

1) Familiarization of raw data (correcting transcripts)
2) Preliminary coding with priori themes
3) Initial coding template
4) Analysis of parts of transcripts using initial template
5) Template iteration
6) Final template analysis of entire data set

Transcription software. Listened it through and corrected, and coded together.

Took out design principles form the analysis

33
Q

What would’ve been great for this studies abductive approach?

A

Test the conceptual framework through subsequent data collection and iterate on it again.

34
Q

Explain the abductive approach

A

Generalising from the interactions between the specific and the general.

Moving back and forth between theory to data or data to theory.

“Den her svane er hvid, måske er alle svaner hvide? Teorien siger også at alle svaner er hvide. Baseret på begge, kan vi se at de er hvide”

Genererer, modificerer, eller indkorporeres i eksisterende teori

35
Q

Describe positivism

A
  • One true reality
  • Scientific method and observable and measurable facts
  • Researchers are neutral and detached from the research
  • Deductive method with quantitative data
36
Q

Describe interpretivism

A
  • Complex and rich reality through social constructs
  • Theories are to simplistic –> focus on stories, perceptions, narratives
  • Value-bound, Researchers are part of what is researched, subjective
  • Inductive, small sample, in-depth investigations
37
Q

Describe pragmatism

A
  • Complex and rich reality as a consequence of experiences, ideas, practices, and processes
  • “True” theories are those that enable successful actions
  • Value-driven research (we know we are a part of it)
  • Follows research problems and questions utilizing a range of methods with an emphasis on practical outcomes and solutions
38
Q

Describe post-modernism

A
  • Reality is social constructs
  • Truth and knowledge is defined by dominant ideologies
  • Researcher and research embedded in power relations
  • Deconstructive (reading texts against themselfes)
39
Q

Describe critical realism

A
  • There is a real world seen through our eyes
  • Facts are social constructs
  • Value-laiden research where researchers are biased (try to minimze this)
  • Often retroductive studies
40
Q

Mention other Methods for research studies

A

1) mono method quantitative
2) mono method qualitative
3) Multimethod quant.
4) Multimethod qual.
5) Mixed method

41
Q

Mention other Research strategies

A

1) Experiment
2) Survey
3) Archival research
4) Case study
5) Narrative Inquiry

42
Q

Validity refers to?

A

The appropriateness of the measures used, accuracy of the analysis of the results and generalisability of the findings.

43
Q

Reliability refers to?

A

Reliability refers to replication and consistency.

If a researcher is able to replicate an earlier research design and achieve the same findings, then that research would be seen as being reliable

44
Q

What is the qualitative comparison to Reliability?

A

Dependability.

Creating transparent research, so it may be understood and evaluated by others.

Means recording all of the changes to produce a reliable/dependable account of the emerging research focus that may be understood and evaluated by others

45
Q

What is the qualitative comparison to Validity?

A

Credibility: (i.e. of the findings from partcipants): Ensuring that the representations of the research participants’ socially constructed realities actually match what the participants intended. - Does the researchers understand the meaning?

Transferability (i.e. generalisability): How well the research transfers to another context or research study.
- By providing a full description of the research questions, design, context, findings and interpretations, the researcher provides the reader with the opportunity to judge the transferability of the study to another setting in which the reader is interested to research