Subtopic Deep Dive

← Mobile Health and mHealth Applications

Quality Assessment of Health Mobile Applications
Research Guide

What is Quality Assessment of Health Mobile Applications?

Quality Assessment of Health Mobile Applications involves standardized frameworks like MARS for evaluating usability, content accuracy, functionality, and evidence-based features in mHealth apps.

Researchers use tools such as the Mobile App Rating Scale (MARS) developed by Stoyanov et al. (2015) with 2384 citations to objectively classify app quality. The user version uMARS by Stoyanov et al. (2016, 927 citations) enables end-users to reliably assess apps. Systematic reviews benchmark thousands of apps from stores, revealing widespread quality gaps.

Curated Papers

Key Challenges

Why It Matters

Clinicians rely on MARS scores to recommend safe apps for patient self-management, as low-quality apps risk misinformation (Stoyanov et al., 2015). Developers use these checklists to build evidence-based features, improving adherence in chronic disease apps (Hamine et al., 2015). Regulators reference reviews like Marcolino et al. (2018) to enforce standards, protecting 40,000+ health apps from harming users (Boulos et al., 2014).

Key Research Challenges

Lack of Evidence-Based Efficacy

Most mental health apps lack rigorous trials, with reviews showing mixed outcomes (Donker et al., 2013; Bakker et al., 2016). Users need education on unproven claims. Systematic quality checks reveal insufficient scientific backing.

Inconsistent Methodological Quality

mHealth reviews report low study quality and limited efficacy evidence across fields (Marcolino et al., 2018). Interventions show potential but require powered trials (Free et al., 2013). Standardization remains inconsistent.

Poor User Engagement Metrics

Real-world app usage patterns are understudied, hindering self-management potential (Baumel et al., 2019). Engagement data is sparse for chronic disease tools (Whitehead and Seaton, 2016). Objective tracking tools are needed.

Essential Papers

Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps

Stoyan Stoyanov, Leanne Hides, David J. Kavanagh et al. · 2015 · JMIR mhealth and uhealth · 2.4K citations

The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new ...

The Effectiveness of Mobile-Health Technology-Based Health Behaviour Change or Disease Management Interventions for Health Care Consumers: A Systematic Review

Caroline Free, Gemma Phillips, Leandro Galli et al. · 2013 · PLoS Medicine · 1.8K citations

Text messaging interventions increased adherence to ART and smoking cessation and should be considered for inclusion in services. Although there is suggestive evidence of benefit in some other area...

Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review

Tara Donker, Katherine Petrie, Judith Proudfoot et al. · 2013 · Journal of Medical Internet Research · 1.2K citations

Mental health apps have the potential to be effective and may significantly improve treatment accessibility. However, the majority of apps that are currently available lack scientific evidence abou...

The Impact of mHealth Interventions: Systematic Review of Systematic Reviews

Milena Soriano Marcolino, João Antônio de Queiroz Oliveira, Marcelo D’Agostino et al. · 2018 · JMIR mhealth and uhealth · 1.2K citations

Although mHealth is growing in popularity, the evidence for efficacy is still limited. In general, the methodological quality of the studies included in the systematic reviews is low. For some fiel...

Impact of mHealth Chronic Disease Management on Treatment Adherence and Patient Outcomes: A Systematic Review

Saee Hamine, Emily Gerth‐Guyette, Dunia Faulx et al. · 2015 · Journal of Medical Internet Research · 1.2K citations

There is potential for mHealth tools to better facilitate adherence to chronic disease management, but the evidence supporting its current effectiveness is mixed. Further research should focus on u...

Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments

David Bakker, Nikolaos Kazantzis, Debra Rickwood et al. · 2016 · JMIR Mental Health · 939 citations

Background The number of mental health apps (MHapps) developed and now available to smartphone users has increased in recent years. MHapps and other technology-based solutions have the potential to...

Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS)

Stoyan Stoyanov, Leanne Hides, David J. Kavanagh et al. · 2016 · JMIR mhealth and uhealth · 927 citations

The uMARS is a simple tool that can be reliably used by end-users to assess the quality of mHealth apps.

Reading Guide

Foundational Papers

Start with Stoyanov et al. (2015) for MARS core framework, then Free et al. (2013) for early efficacy evidence, and Donker et al. (2013) for mental health gaps to build baseline understanding.

Recent Advances

Study uMARS validation (Stoyanov et al., 2016), engagement analysis (Baumel et al., 2019), and chronic disease reviews (Hamine et al., 2015) for current advances.

Core Methods

Core techniques: MARS/uMARS subscale scoring by experts/users, app store systematic searches, inter-rater reliability stats, GRADE for evidence synthesis.

How PapersFlow Helps You Research Quality Assessment of Health Mobile Applications

Discover & Search

Research Agent uses searchPapers and citationGraph to map MARS framework evolution from Stoyanov et al. (2015), then findSimilarPapers uncovers 50+ quality assessment tools. exaSearch queries app store benchmarks like Arnhold et al. (2014) for diabetes apps.

Analyze & Verify

Analysis Agent applies readPaperContent on Stoyanov et al. (2015) to extract MARS subscales, verifyResponse with CoVe checks claims against Free et al. (2013), and runPythonAnalysis computes inter-rater reliability stats from uMARS data (Stoyanov et al., 2016). GRADE grading evaluates evidence strength in mHealth reviews.

Synthesize & Write

Synthesis Agent detects gaps in app efficacy evidence from Marcolino et al. (2018), flags contradictions in engagement metrics (Baumel et al., 2019). Writing Agent uses latexEditText for MARS review tables, latexSyncCitations for 20+ papers, latexCompile for submission-ready manuscript, and exportMermaid for quality framework flowcharts.

Use Cases

"Run statistical analysis on MARS scores across mental health apps from recent reviews."

Research Agent → searchPapers('MARS mental health apps') → Analysis Agent → readPaperContent(Stoyanov 2015) + runPythonAnalysis(pandas correlation of subscales) → matplotlib plot of usability vs. efficacy.

"Write a LaTeX review comparing MARS and uMARS for diabetes app evaluation."

Synthesis Agent → gap detection(MARS diabetes) → Writing Agent → latexEditText(intro) → latexSyncCitations(Stoyanov 2015, Arnhold 2014) → latexCompile → PDF with embedded tables.

"Find GitHub repos implementing mobile app quality assessment tools."

Research Agent → searchPapers('MARS implementation code') → paperExtractUrls → paperFindGithubRepo → githubRepoInspect → exportCsv of usability scripts for diabetes apps.

Automated Workflows

Deep Research workflow conducts systematic reviews: searchPapers(quality mHealth) → citationGraph(MARS cluster) → DeepScan 7-steps with GRADE checkpoints on Stoyanov et al. (2015). Theorizer generates hypotheses on uMARS for chronic apps from Hamine et al. (2015). DeepScan verifies engagement claims in Baumel et al. (2019) via CoVe.

Try Doxa for Quality Assessment of Health Mobile Applications Research

Frequently Asked Questions

What is the MARS framework?

MARS is a reliable tool with four subscales—engagement, functionality, aesthetics, information quality—for assessing health app quality (Stoyanov et al., 2015).

What methods are used in quality assessment?

Methods include expert rater scoring via MARS/uMARS, systematic app store reviews, and usability tests for patient groups like diabetics over 50 (Stoyanov et al., 2016; Arnhold et al., 2014).

What are key papers on this topic?

Stoyanov et al. (2015, 2384 citations) introduced MARS; Stoyanov et al. (2016, 927 citations) validated uMARS; Donker et al. (2013, 1210 citations) reviewed mental health app evidence.

What open problems exist?

Challenges include scaling real-world engagement tracking, standardizing evidence for non-mental health apps, and improving methodological rigor in reviews (Baumel et al., 2019; Marcolino et al., 2018).