Subtopic Deep Dive
Delphi Method
Research Guide
What is Delphi Method?
The Delphi method is a structured communication technique using iterative, anonymous surveys of experts to achieve consensus on complex issues lacking empirical data.
Developed in the 1950s at RAND Corporation, it involves multiple rounds of questionnaires with controlled feedback between rounds. Experts refine opinions anonymously to converge on forecasts or decisions. Over 10,000 papers apply it across health, policy, and social sciences (Hasson et al., 2000; Hsu and Sandford, 2020).
Why It Matters
Delphi enables consensus in data-scarce domains like dementia prevalence estimation (Ferri et al., 2005, 5296 citations) and behavior change taxonomies (Michie et al., 2013, 7305 citations). It structures expert input for policy, as in global health guidelines (Hasson et al., 2000). Applications span implementation strategies (Powell et al., 2015, 4448 citations) and systematic review protocols (Moher et al., 2015, 25062 citations), informing decisions without direct experimentation.
Key Research Challenges
Anonymity Maintenance
Ensuring true anonymity prevents dominance by influential experts, risking biased convergence (Hasson et al., 2000). Protocols must control feedback to avoid groupthink. Hsu and Sandford (2020) note inconsistent anonymity erodes method validity.
Stopping Criteria Definition
Determining when consensus is reached lacks standardization, with subjective thresholds like 70% agreement common (Hasson et al., 2000). Variable expert stability complicates decisions. Recent guidelines call for predefined statistical rules (Hsu and Sandford, 2020).
Expert Panel Selection
Selecting diverse, representative experts is challenging without clear criteria, leading to narrow perspectives (Ferri et al., 2005). Hasson et al. (2000) provide selection guidelines, but applications vary widely. Bias from non-response remains prevalent.
Essential Papers
Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement
David Moher, Larissa Shamseer, Mike Clarke et al. · 2015 · Systematic Reviews · 25.1K citations
Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described pro...
Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide
Tammy Hoffmann, Paul Glasziou, Isabelle Boutron et al. · 2014 · BMJ · 9.5K citations
Without a complete published description of interventions, clinicians and patients cannot reliably implement interventions that are shown to be useful, and other researchers cannot replicate or bui...
AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both
Beverley Shea, Barnaby C Reeves, George A. Wells et al. · 2017 · BMJ · 9.5K citations
The number of published systematic reviews of studies of healthcare interventions has increased rapidly and these are used extensively for clinical and policy decisions. Systematic reviews are subj...
The PRISMA Extension Statement for Reporting of Systematic Reviews Incorporating Network Meta-analyses of Health Care Interventions: Checklist and Explanations
Brian Hutton, Georgia Salanti, Deborah M Caldwell et al. · 2015 · Annals of Internal Medicine · 7.6K citations
The PRISMA statement is a reporting guideline designed to improve the completeness of reporting of systematic reviews and meta-analyses. Authors have used this guideline worldwide to prepare their ...
The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions
Susan Michie, Michelle Richardson, Marie Johnston et al. · 2013 · Annals of Behavioral Medicine · 7.3K citations
"BCT taxonomy v1," an extensive taxonomy of 93 consensually agreed, distinct BCTs, offers a step change as a method for specifying interventions, but we anticipate further development and evaluatio...
Global prevalence of dementia: a Delphi consensus study
Cleusa P. Ferri, Martin Prince, Carol Brayne et al. · 2005 · The Lancet · 5.3K citations
International Classification of Functioning Disability and Health (ICF)
Linamara Rizzo Battistella, Christina May Moran de Brito · 2002 · Acta Fisiátrica · 4.5K citations
O presente artigo tem por objetivo a atualização e a familiarização de profissionais envolvidos com a reabilitação daClassificação Internacional de Funcionalidade (CIF) desenvolvida pela Organizaçã...
Reading Guide
Foundational Papers
Start with Hasson et al. (2000) for Delphi survey guidelines, then Ferri et al. (2005) for real-world health application, as they establish core protocols and demonstrate global consensus.
Recent Advances
Study Hsu and Sandford (2020) for modern consensus explanations and Powell et al. (2015) for implementation strategy refinements using Delphi.
Core Methods
Core techniques include anonymous rounds (Hasson et al., 2000), controlled feedback, median/Q1-Q3 stability, and predefined consensus thresholds like 75% agreement within one point.
How PapersFlow Helps You Research Delphi Method
Discover & Search
Research Agent uses searchPapers and exaSearch to find Delphi applications like 'Research guidelines for the Delphi survey technique' by Hasson et al. (2000). citationGraph reveals connections to consensus studies like Ferri et al. (2005), while findSimilarPapers expands to related protocols such as Moher et al. (2015).
Analyze & Verify
Analysis Agent applies readPaperContent to extract Delphi protocols from Hasson et al. (2000), then verifyResponse (CoVe) checks consensus criteria against GRADE grading for evidence quality. runPythonAnalysis computes inter-round agreement statistics from survey data tables, verifying stability thresholds.
Synthesize & Write
Synthesis Agent detects gaps in Delphi stopping rules across papers, flagging contradictions between Hasson et al. (2000) and Hsu and Sandford (2020). Writing Agent uses latexEditText and latexSyncCitations to draft methods sections, latexCompile for full reports, and exportMermaid for flowcharting iterative rounds.
Use Cases
"Analyze convergence statistics from Delphi dementia study"
Research Agent → searchPapers(Ferri 2005) → Analysis Agent → readPaperContent → runPythonAnalysis(pandas on round data) → statistical output with agreement plots.
"Draft LaTeX protocol for new Delphi on policy consensus"
Synthesis Agent → gap detection(Hasson 2000) → Writing Agent → latexEditText(methods) → latexSyncCitations(10 papers) → latexCompile → PDF with Delphi flowchart.
"Find code for Delphi simulation from recent papers"
Research Agent → searchPapers(Delphi simulation) → Code Discovery → paperExtractUrls → paperFindGithubRepo → githubRepoInspect → R script for round iterations.
Automated Workflows
Deep Research workflow conducts systematic Delphi review: searchPapers(50+ hits) → citationGraph → DeepScan(7-step critique with GRADE) → structured report on protocols. Theorizer generates new stopping criteria theories from Hasson et al. (2000) and Hsu and Sandford (2020) via gap detection chains. DeepScan verifies consensus metrics across Ferri et al. (2005) applications with CoVe checkpoints.
Frequently Asked Questions
What defines the Delphi method?
Delphi uses iterative, anonymous expert surveys with feedback to reach consensus on forecasts (Hasson et al., 2000; Hsu and Sandford, 2020).
What are core Delphi methods?
Involves 2-4 questionnaire rounds, summary feedback, anonymity, and stability checks like 70% agreement (Hasson et al., 2000).
What are key Delphi papers?
Hasson et al. (2000, 4253 citations) gives guidelines; Ferri et al. (2005, 5296 citations) applies to dementia; Hsu and Sandford (2020, 4196 citations) explains consensus.
What open problems exist in Delphi?
Standardizing stopping rules, expert selection bias, and scalability to large panels lack consensus (Hsu and Sandford, 2020).
Research Delphi Technique in Research with AI
PapersFlow provides specialized AI tools for Social Sciences researchers. Here are the most relevant for this topic:
Systematic Review
AI-powered evidence synthesis with documented search strategies
AI Literature Review
Automate paper discovery and synthesis across 474M+ papers
Deep Research Reports
Multi-source evidence synthesis with counter-evidence
Find Disagreement
Discover conflicting findings and counter-evidence
See how researchers in Social Sciences use PapersFlow
Field-specific workflows, example queries, and use cases.
Start Researching Delphi Method with AI
Search 474M+ papers, run AI-powered literature reviews, and write with integrated citations — all in one workspace.
See how PapersFlow works for Social Sciences researchers
Part of the Delphi Technique in Research Research Guide