Subtopic Deep Dive
Nominal Group Technique
Research Guide
What is Nominal Group Technique?
Nominal Group Technique (NGT) is a structured group process for idea generation and priority ranking through silent individual work followed by round-robin sharing and voting.
NGT facilitates consensus in face-to-face settings, contrasting with Delphi's iterative anonymity (Jones and Hunter, 1995, 3394 citations). Participants independently generate ideas, discuss without debate, and rank priorities collectively. Over 200 studies integrate NGT with Delphi for hybrid designs in health services research.
Why It Matters
NGT enables rapid priority setting in healthcare quality improvement, as used in indicator selection (Boulkedid et al., 2011). It reduces dominance by vocal members, improving equity in participatory research compared to open brainstorming (Fink et al., 1984). Jones and Hunter (1995) demonstrate NGT's application in medical consensus where evidence is limited, influencing guidelines like COSMIN methodology (Mokkink et al., 2010).
Key Research Challenges
Group Dominance Mitigation
Vocal participants can sway rankings despite silent generation. Jones and Hunter (1995) note incomplete prevention in practice. Facilitator training remains inconsistent across studies.
Scalability Limits
NGT suits small groups (6-12) but falters in larger assemblies. Fink et al. (1984) highlight efficiency loss beyond optimal size. Hybrid NGT-Delphi designs address this partially (Boulkedid et al., 2011).
Validity Measurement
Ranking stability lacks standardized metrics versus Delphi iterations. Mokkink et al. (2010) COSMIN checklist reveals gaps in NGT psychometric reporting. Content validity assessments are rarely quantified.
Essential Papers
AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both
Beverley Shea, Barnaby C Reeves, George A. Wells et al. · 2017 · BMJ · 9.5K citations
The number of published systematic reviews of studies of healthcare interventions has increased rapidly and these are used extensively for clinical and policy decisions. Systematic reviews are subj...
The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study
Lidwine B. Mokkink, Caroline B. Terwee, Donald L. Patrick et al. · 2010 · Quality of Life Research · 3.9K citations
The resulting COSMIN checklist could be useful when selecting a measurement instrument, peer-reviewing a manuscript, designing or reporting a study on measurement properties, or for educational pur...
Qualitative Research: Consensus methods for medical and health services research
Jeremy Jones, Duncan Hunter · 1995 · BMJ · 3.4K citations
Health providers face the problem of trying to make decisions in situations where there is insufficient information and also where there is an overload of (often contradictory) information. Statist...
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
Sandra Eldridge, Claire Chan, Michael J. Campbell et al. · 2016 · BMJ · 3.1K citations
Consolidated Standards of Reporting Trials (CONSORT) statement is a guideline designed to improve the transparency and quality of the reporting of randomised controlled trials (RCTs). In this artic...
COSMIN guideline for systematic reviews of patient-reported outcome measures
C.A.C. Prinsen, Lidwine B. Mokkink, L.M. Bouter et al. · 2018 · Quality of Life Research · 3.0K citations
The COSMIN guideline for systematic reviews of PROMs includes methodology to combine the methodological quality of studies on measurement properties with the quality of the PROM itself (i.e., its m...
The Delphi List
Arianne P. Verhagen, Henrica C. W. de Vet, Robert A. de Bie et al. · 1998 · Journal of Clinical Epidemiology · 2.3K citations
Consensus methods: characteristics and guidelines for use.
Alexander Fink, Jacqueline Kosecoff, M R Chassin et al. · 1984 · American Journal of Public Health · 2.1K citations
Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when p...
Reading Guide
Foundational Papers
Start with Jones and Hunter (1995) for NGT overview in health consensus, then Fink et al. (1984) for guidelines, followed by Mokkink et al. (2010) for methodological quality assessment.
Recent Advances
Prinsen et al. (2018) COSMIN guideline extends NGT applications; Williamson et al. (2017) COMET Handbook integrates for core outcome sets.
Core Methods
Silent generation, round-robin, controlled discussion, Borda count or ranking vote; hybrid with Delphi for iteration (Boulkedid et al., 2011).
How PapersFlow Helps You Research Nominal Group Technique
Discover & Search
Research Agent uses searchPapers to query 'Nominal Group Technique consensus methods' retrieving Jones and Hunter (1995), then citationGraph reveals 3394 downstream citations linking to COSMIN applications, while findSimilarPapers surfaces Fink et al. (1984) for guidelines.
Analyze & Verify
Analysis Agent applies readPaperContent on Jones and Hunter (1995) to extract NGT steps, verifyResponse with CoVe checks consensus against Mokkink et al. (2010), and runPythonAnalysis computes Kendall's W rank agreement from extracted voting data using SciPy, with GRADE grading for methodological quality.
Synthesize & Write
Synthesis Agent detects gaps in NGT-Delphi hybrids via contradiction flagging across Boulkedid et al. (2011) and Verhagen et al. (1998); Writing Agent uses latexEditText for methods section, latexSyncCitations to integrate 10+ references, latexCompile for PDF, and exportMermaid diagrams NGT vs Delphi flows.
Use Cases
"Compare NGT ranking statistics across healthcare consensus papers"
Research Agent → searchPapers → Analysis Agent → runPythonAnalysis (pandas aggregation of Kendall coefficients from 5 papers) → CSV export of agreement scores table.
"Draft LaTeX section on NGT-Delphi hybrid for quality indicators review"
Synthesis Agent → gap detection → Writing Agent → latexEditText + latexSyncCitations (Boulkedid 2011 et al.) + latexCompile → formatted PDF with flowchart.
"Find code implementations of Nominal Group Technique voting"
Research Agent → paperExtractUrls (Jones 1995) → Code Discovery → paperFindGithubRepo → githubRepoInspect → Python ranking script with vote aggregation.
Automated Workflows
Deep Research workflow scans 50+ consensus papers via searchPapers → citationGraph, generating structured NGT comparison report with GRADE scores. DeepScan applies 7-step verification: readPaperContent on Fink (1984) → CoVe → runPythonAnalysis for guideline extraction. Theorizer builds hybrid NGT-Delphi theory from Mokkink (2010) patterns.
Frequently Asked Questions
What defines Nominal Group Technique?
NGT involves silent idea generation, round-robin sharing, discussion, and collective ranking without debate (Jones and Hunter, 1995).
What are core NGT methods?
Steps include individual brainstorming (5-10 min), round-robin listing, clarification rounds, and voting via ranking or points (Fink et al., 1984).
What are key NGT papers?
Jones and Hunter (1995, 3394 citations) overviews methods; Fink et al. (1984, 2068 citations) provides guidelines; Mokkink et al. (2010, 3926 citations) applies in COSMIN.
What open problems exist in NGT?
Standardized validity metrics for rankings, scalability to large groups, and hybrid integration with Delphi lack consensus (Boulkedid et al., 2011).
Research Delphi Technique in Research with AI
PapersFlow provides specialized AI tools for Social Sciences researchers. Here are the most relevant for this topic:
Systematic Review
AI-powered evidence synthesis with documented search strategies
AI Literature Review
Automate paper discovery and synthesis across 474M+ papers
Deep Research Reports
Multi-source evidence synthesis with counter-evidence
Find Disagreement
Discover conflicting findings and counter-evidence
See how researchers in Social Sciences use PapersFlow
Field-specific workflows, example queries, and use cases.
Start Researching Nominal Group Technique with AI
Search 474M+ papers, run AI-powered literature reviews, and write with integrated citations — all in one workspace.
See how PapersFlow works for Social Sciences researchers
Part of the Delphi Technique in Research Research Guide