Skip to content

Compare methods

Compare source explanations, strengths, limitations and references for up to four methods.

7 results
Criterion Realist Synthesis Qualitative Meta-Synthesis
Overview
  • Realist synthesis is a theory-driven, interpretive method for evidence synthesis developed by Ray Pawson (2005) that focuses on understanding HOW and WHY interventions work, rather than WHETHER they work. Grounded in realist philosophy, realist synthesis examines Context-Mechanism-Outcome (CMO) configurations: how specific contextual conditions activate mechanisms that produce outcomes. Unlike traditional systematic reviews, which typically answer 'Does intervention X reduce outcome Y?', realist synthesis asks 'Under what conditions, through what mechanisms, for which populations does X work?' This approach is particularly valuable for complex interventions (policies, programs, multi-component treatments) where effectiveness varies dramatically across contexts, and for understanding why interventions succeed in some settings but fail in others.
  • Qualitative meta-synthesis is a systematic method for synthesizing findings from multiple qualitative research studies (interviews, focus groups, ethnographies) to develop integrated interpretations and theoretical insights. Formalized by Sandelowski and Barroso (2007) and popularized by Thomas and Harden (2008), qualitative meta-synthesis preserves the rich, contextual, interpretive nature of qualitative evidence while enabling broader conclusions across multiple studies. Unlike quantitative meta-analysis, which pools numbers, qualitative meta-synthesis synthesizes themes, meanings, and conceptual insights—answering questions like 'How do cancer patients experience treatment side effects?' or 'What factors shape patient engagement with preventive health programs?' across multiple studies.
Use and interpretation
  • Use realist synthesis when (1) you need to understand how and why complex interventions work, not just whether they work, (2) evidence suggests the intervention's effectiveness varies dramatically across contexts or populations, (3) mechanisms of change are unclear and stakeholders need insight into causal pathways, (4) you are designing or implementing a program and need to understand what conditions enable success, (5) prior systematic reviews concluded 'the evidence is mixed' and you want to understand why, or (6) you aim to identify leverage points for policy or practice improvement (e.g., which aspects of context must change to enable intervention success). Common applications include implementation science, health systems strengthening, education policy, criminal justice programs, and complex social interventions.
  • Conduct qualitative meta-synthesis when (1) you need to understand patient or clinician experiences, perspectives, or meanings related to a health or social phenomenon, (2) multiple qualitative studies exist on your topic but each is limited in scope or setting, (3) you want to identify common themes and contextual variations in how people experience or respond to an intervention, condition, or policy, (4) you need to develop theory or conceptual frameworks grounded in qualitative evidence across multiple contexts, or (5) qualitative evidence is more appropriate than quantitative evidence for your research question (e.g., understanding barriers to care-seeking, exploring meaning of illness, assessing acceptability of interventions).
Strengths
  • Addresses complexity explicitly: acknowledges that interventions' effects depend on context and mechanisms, not just intervention components alone.
  • Synthesizes diverse evidence types: RCTs inform effectiveness, qualitative studies illuminate mechanisms, implementation research reveals context barriers—all contribute to understanding.
  • Produces actionable theory: Rather than 'This program works (p <0.05),' synthesis produces 'This program works when X, Y, Z conditions are met; mechanisms are A, B, C; in other contexts, mechanisms are blocked by barriers 1, 2, 3.'
  • Iterative and reflexive: theory evolves as evidence is examined; researchers remain transparent about how theory changed during synthesis.
  • Particularly powerful for explaining heterogeneity: if studies show different effects, realist synthesis asks why (context/mechanism differences) rather than treating heterogeneity as a nuisance.
  • Preserves richness and context of qualitative data while enabling synthesis across multiple studies and settings, developing broader conceptual understanding.
  • Identifies common themes and meanings across diverse populations, generating theoretical insights about human experience and behavior.
  • Examines contextual variations: 'This theme appears strongly in studies from Western settings; that theme is stronger in non-Western studies'—enabling culturally-sensitive interpretation.
  • Integrates contradictions and refutations: when studies reach different conclusions, meta-synthesis investigates reasons (different populations, contexts, or truly contradictory evidence) rather than ignoring disagreement.
  • Transparent and systematic: even though interpretive, qualitative meta-synthesis uses explicit search, inclusion criteria, quality assessment, and analytical procedures, increasing credibility.
Limitations
  • Requires deep substantive knowledge and theoretical sophistication. Realist synthesis is not a straightforward checklist; it demands judgment about mechanisms and causal theory.
  • More interpretive than quantitative systematic reviews, introducing subjectivity. Different reviewers may construct different theories from the same evidence. Transparency and stakeholder engagement reduce but do not eliminate this risk.
  • Inclusion criteria are looser than traditional systematic reviews (includes diverse study types, some of lower quality). Studies are judged on relevance to program theory, not standardized inclusion criteria. This can lead to less rigorous data if not carefully managed.
  • Time-consuming and resource-intensive due to iterative approach and need to understand mechanisms deeply. May not be feasible under tight timelines.
  • Interpretive and subjective: multiple researchers may synthesize the same studies and reach different conceptual conclusions. Qualitative meta-synthesis requires researcher judgment; results are not as replicable as quantitative synthesis.
  • Quality variable across included studies: some included qualitative studies may be small, poorly described, or lacking methodological rigor. While quality variation is acknowledged, it can affect confidence in findings.
  • Heterogeneity in original studies: qualitative studies may use very different methodologies (phenomenology, grounded theory, ethnography), populations, and analytical frameworks. Synthesizing across such diversity requires interpretive skill.
  • Abstractions may lose nuance: deriving higher-level conceptual themes inevitably loses some contextual and individual detail present in original studies. Balance conceptual abstraction with grounding in original data.
Common pitfalls
  • Imposing a predetermined theory uncritically. Realist synthesis should be iterative and data-responsive, not wedded to initial theory. Be prepared to discard or substantially revise initial CMO configurations if evidence contradicts them.
  • Including studies of poor methodological quality without acknowledging limitations. Just because diverse evidence is included does not mean all studies are equally trustworthy. Weight evidence quality explicitly.
  • Overstating the explanatory power of refined theory. Realist synthesis produces plausible theories grounded in evidence, but it does not 'prove' mechanisms. Acknowledge remaining uncertainty, especially about mechanisms poorly represented in available literature.
  • Neglecting quantitative evidence. Realist synthesis values qualitative insights about mechanisms, but quantitative evidence (from trials, surveys) about effect sizes and population characteristics is equally important. Balance depth of mechanism understanding with breadth of outcome evidence.
  • Treating qualitative meta-synthesis as 'extracting key findings and listing themes' without deeper synthesis. Genuine synthesis develops new conceptual insights; simple listing of themes from multiple studies is not synthesis.
  • Forcing consistency when genuine contradiction exists. If studies reach different conclusions about a phenomenon, investigate this contradiction rather than smoothing it over. Differences may reflect genuine contextual variation or differences in how phenomena were understood.
  • Ignoring researcher reflexivity and positionality. Qualitative research is influenced by researcher perspective. Meta-synthesis should acknowledge how researchers' backgrounds and assumptions shaped original studies and your synthesis interpretation.
  • Mixing qualitative and quantitative studies without clear separation. If you include both qualitative and quantitative studies, synthesize them in distinct sections; integrating numbers with thematic meanings creates confusion.
Introduced by
  • Ray Pawson (2005)
  • Sandelowski & Barroso (2007), Popularized by Thomas & Harden (2008)
Year
  • 2005
  • 2007