Subtopic Deep Dive
Altmetrics and Social Impact Assessment
Research Guide
What is Altmetrics and Social Impact Assessment?
Altmetrics measure online scholarly impact through social media mentions, downloads, and policy citations beyond traditional citations.
Altmetrics emerged to capture rapid public engagement with research outputs. Key studies analyze correlations between altmetrics like Twitter mentions and citations across disciplines (Eysenbach, 2011; 1111 citations; Thelwall et al., 2013; 887 citations). Over 20 papers from 2011-2021 explore validation and multidisciplinary applications.
Why It Matters
Altmetrics enable evaluation of open access impact and societal reach in funding decisions (Eysenbach, 2011). They predict citations days after publication, aiding rapid assessment (Thelwall et al., 2013). Policymakers use altmetrics for public engagement metrics in grant evaluations (Costas et al., 2014; Sugimoto et al., 2017).
Key Research Challenges
Correlation Variability Across Fields
Altmetrics show weak or field-specific correlations with citations, limiting general use (Thelwall et al., 2013). Twitter data density varies by discipline, complicating comparisons (Costas et al., 2014). Multidisciplinary validation remains inconsistent.
Data Quality and Noise
Social web sources include bots and irrelevant mentions, inflating scores (Thelwall et al., 2013). Altmetric.com coverage differs by platform, affecting reliability (Costas et al., 2014). Cleaning noisy data requires robust preprocessing.
Validation Against Societal Impact
Altmetrics poorly proxy true societal influence beyond citations (Thelwall et al., 2013). Evidence lacks for policy document mentions as impact indicators (Sugimoto et al., 2017). Longitudinal studies needed for causal links.
Essential Papers
Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies
Jeroen Baas, Michiel Schotten, Andrew Plume et al. · 2020 · Quantitative Science Studies · 1.6K citations
Scopus is among the largest curated abstract and citation databases, with a wide global and regional coverage of scientific journals, conference proceedings, and books, while ensuring only the high...
Software tools for conducting bibliometric analysis in science: An up-to-date review
José A. Moral-Muñoz, Enrique Herrera‐Viedma, Antonio Santisteban‐Espejo et al. · 2020 · El Profesional de la Informacion · 1.5K citations
Bibliometrics has become an essential tool for assessing and analyzing the output of scientists, cooperation between \nuniversities, the effect of state-owned science funding on national resear...
Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact
Günther Eysenbach · 2011 · Journal of Medical Internet Research · 1.1K citations
Tweets can predict highly cited articles within the first 3 days of article publication. Social media activity either increases citations or reflects the underlying qualities of the article that al...
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Mike Thelwall, Stefanie Haustein, Vincent Larivière et al. · 2013 · PLoS ONE · 887 citations
Altmetric measurements derived from the social web are increasingly advocated and used as early indicators of article impact and usefulness. Nevertheless, there is a lack of systematic scientific e...
Bibliometrics: Methods for studying academic publishing
Anton Ninkov, Jason R. Frank, Lauren A. Maggio · 2021 · Perspectives on Medical Education · 814 citations
Bibliometrics is the study of academic publishing that uses statistics to describe publishing trends and to highlight relationships between published works. Likened to epidemiology, researchers see...
Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
Rodrigo Costas, Zohreh Zahedi, Paul Wouters · 2014 · Journal of the Association for Information Science and Technology · 709 citations
An extensive analysis of the presence of different altmetric indicators provided by Altmetric.com across scientific fields is presented, particularly focusing on their relationship with citations. ...
Web of Science use in published research and review papers 1997–2017: a selective, dynamic, cross-domain, content-based analysis
Kai Li, Jason Rollins, Erjia Yan · 2017 · Scientometrics · 666 citations
Reading Guide
Foundational Papers
Read Eysenbach (2011) first for tweet-citation prediction; then Thelwall et al. (2013) and Costas et al. (2014) for broad altmetrics validation across services and fields.
Recent Advances
Study Sugimoto et al. (2017) for scholarly social media review; Ninkov et al. (2021) contextualizes bibliometrics methods.
Core Methods
Pearson/Spearman correlations for altmetrics-citations; density analysis by field; Altmetric.com API data extraction.
How PapersFlow Helps You Research Altmetrics and Social Impact Assessment
Discover & Search
Research Agent uses searchPapers and exaSearch to find altmetrics papers like Eysenbach (2011), then citationGraph reveals clusters around Thelwall et al. (2013) and Costas et al. (2014). findSimilarPapers expands to related social impact works from 250M+ OpenAlex papers.
Analyze & Verify
Analysis Agent applies readPaperContent to extract correlation coefficients from Costas et al. (2014), then runPythonAnalysis with pandas computes meta-analysis of altmetrics-citation correlations across provided papers. verifyResponse (CoVe) and GRADE grading confirm statistical claims with evidence levels.
Synthesize & Write
Synthesis Agent detects gaps in altmetrics validation post-2017 via contradiction flagging on Sugimoto et al. (2017). Writing Agent uses latexEditText, latexSyncCitations for bibliometric reports, and latexCompile to generate review papers with exportMermaid for correlation flowcharts.
Use Cases
"Correlate Twitter mentions with citations in biomedicine papers using Python stats"
Research Agent → searchPapers(Eysenbach 2011) → Analysis Agent → readPaperContent + runPythonAnalysis(pandas correlation matrix on 10 altmetrics papers) → researcher gets CSV of r-values and p-values.
"Draft LaTeX review on altmetrics validity with citations"
Research Agent → citationGraph(Thelwall 2013) → Synthesis → gap detection → Writing Agent → latexEditText(intro) → latexSyncCitations(15 papers) → latexCompile → researcher gets PDF with synced bibtex.
"Find GitHub repos analyzing altmetrics datasets"
Research Agent → searchPapers(altmetrics datasets) → Code Discovery → paperExtractUrls → paperFindGithubRepo → githubRepoInspect → researcher gets repo summaries with Python scripts for altmetrics analysis.
Automated Workflows
Deep Research workflow conducts systematic review: searchPapers(altmetrics correlation) → 50+ papers → DeepScan(7-step: extract metrics → Python correlation → GRADE) → structured altmetrics report. Theorizer generates hypotheses on social impact from Eysenbach (2011) + Costas (2014) chains. DeepScan verifies multidisciplinary correlations with CoVe checkpoints.
Frequently Asked Questions
What are altmetrics?
Altmetrics quantify scholarly impact via social media, downloads, and mentions (Thelwall et al., 2013).
What methods validate altmetrics?
Correlation analysis between Twitter counts and citations, plus multidisciplinary comparisons (Eysenbach, 2011; Costas et al., 2014).
What are key papers?
Eysenbach (2011; 1111 citations) shows tweets predict citations; Thelwall et al. (2013; 887 citations) tests 11 services.
What open problems exist?
Field-specific noise reduction and causal societal impact links remain unresolved (Sugimoto et al., 2017).
Research scientometrics and bibliometrics research with AI
PapersFlow provides specialized AI tools for Decision Sciences researchers. Here are the most relevant for this topic:
Systematic Review
AI-powered evidence synthesis with documented search strategies
AI Literature Review
Automate paper discovery and synthesis across 474M+ papers
Deep Research Reports
Multi-source evidence synthesis with counter-evidence
See how researchers in Economics & Business use PapersFlow
Field-specific workflows, example queries, and use cases.
Start Researching Altmetrics and Social Impact Assessment with AI
Search 474M+ papers, run AI-powered literature reviews, and write with integrated citations — all in one workspace.
See how PapersFlow works for Decision Sciences researchers