Subtopic Deep Dive

← Discourse Analysis in Language Studies

Multimodal Discourse Analysis
Research Guide

What is Multimodal Discourse Analysis?

Multimodal Discourse Analysis examines the integration of textual, visual, gestural, and auditory modes in constructing meaning within discourse.

This approach extends traditional discourse analysis by incorporating semiotic resources beyond language, such as images and gestures in digital media. Researchers apply frameworks from Kress and van Leeuwen to analyze websites, memes, and lectures. Over 10 papers from 2005-2021, with Yoon (2016) at 134 citations, highlight applications in education and online communication.

Curated Papers

Key Challenges

Why It Matters

Multimodal Discourse Analysis reveals ideology in internet memes, as in Yoon (2016) analyzing racism in memes through Critical Race Theory. It informs TESOL research guidelines by addressing multimodal practices in academic writing (Mahboob et al., 2016). Applications include marketization in university websites (Zhang, 2017) and engagement strategies in TED talks (Xia and Hafner, 2021), impacting pedagogy and digital communication analysis.

Key Research Challenges

Integrating Multiple Modes

Combining textual, visual, and gestural analysis requires unified frameworks, as visual inputs in lectures demand multimodal explanations (Crawford, 2015). Studies like Räisänen (2020) show challenges in business meetings with English as lingua franca. Developing consistent semiotic tools remains difficult across contexts.

Quantifying Visual Ideology

Assessing hidden ideologies in memes and ads involves subjective interpretation, per Yoon (2016) on colorblindness in racist memes. Pulos (2020) applies rhetorical arena theory to COVID-19 memes, highlighting quantification issues. Reliable metrics for visual discourse effects are lacking.

Digital Genre Evolution

Analyzing rapidly changing digital genres like TED videos challenges static models (Xia and Hafner, 2021). Hu and Luo (2016) use Systemic Functional Linguistics for Tmall ads, but adapting to new platforms persists. Genre-based approaches struggle with cross-disciplinary emphases (Carstens, 2010).

Essential Papers

Why is it not Just a Joke? Analysis of Internet Memes Associated with Racism and Hidden Ideology of Colorblindness

Injeong Yoon · 2016 · Journal of Cultural Research in Art Education · 134 citations

This article discusses how Internet memes associated with racism can be analyzed and pedagogically utilized through the theoretical frame of Critical Race Theory. The assumption of the study is tha...

<scp>TESOL</scp> Quarterly Research Guidelines

Ahmar Mahboob, Brian Paltridge, Aek Phakiti et al. · 2016 · TESOL Quarterly · 61 citations

This article provides research guidelines for authors intending to submit their manuscripts to TESOL Quarterly . These guidelines include information about the TESOL Quarterly review process, advic...

The Marketization of Higher Education Discourse: A Genre Analysis of University Website Homepages in China

Tongtong Zhang · 2017 · Higher Education Studies · 49 citations

The past three decades have witnessed the growing influence of market forces on higher education, resulting in what is defined by Fairclough (1993) as the marketization of academic discourse. The p...

Multimodal Analysis in Academic Settings

CRAWFORD, BELINDA BLANCHE · 2015 · 49 citations

As a defining feature of academic lectures, explanations help learners grasp complex and challenging disciplinary concepts. This chapter focuses on the multimodal dimension of explanations in an in...

COVID-19 crisis memes, rhetorical arena theory and multimodality

Rick Pulos · 2020 · Journal of Science Communication · 44 citations

On February 11, 2020, the World Health Organization announced the name of a new disease, COVID-19. As the virus that causes the disease spread across the globe, the world went into crisis mode. The...

The Use of Multimodal Resources by Technical Managers and Their Peers in Meetings Using English as the Business Lingua Franca

Tiina Räisänen · 2020 · IEEE Transactions on Professional Communication · 40 citations

Background: Engineers increasingly work and advance their careers in international business settings. As technical managers, they need management and technical skills when working with different st...

Multimodality in Higher Education

Bellés Calvera, Lucía · 2016 · 36 citations

Multimodality in Higher Education, by Archer and Breuer (2016) deals with multimodal writing practices and pedagogies in tertiary education. With the boost of new technologies in the field of educa...

Reading Guide

Foundational Papers

Start with Rex et al. (2010, 36 citations) for discourse review in literacy, then Jones and Norris (2005, 29 citations) on action-oriented multimodality to grasp core integration principles.

Recent Advances

Study Yoon (2016, 134 citations) for meme ideology, Pulos (2020, 44 citations) for crisis multimodality, and Xia and Hafner (2021, 36 citations) for digital engagement.

Core Methods

Core methods feature visual semiotics (Hu and Luo, 2016), genre analysis (Zhang, 2017), and rhetorical strategies (Pulos, 2020) applied to lectures, ads, and videos.

How PapersFlow Helps You Research Multimodal Discourse Analysis

Discover & Search

Research Agent uses searchPapers and exaSearch to find Yoon (2016) on racist memes, then citationGraph reveals connections to Pulos (2020) on COVID-19 multimodality and Mahboob et al. (2016) TESOL guidelines. findSimilarPapers expands to Zhang (2017) website analysis.

Analyze & Verify

Analysis Agent employs readPaperContent on Crawford (2015) for lecture multimodality details, verifies claims with CoVe against Rex et al. (2010) review, and runs PythonAnalysis to count modal resources in meme datasets from Yoon (2016) using pandas for frequency stats. GRADE grading assesses evidence strength in ideological claims.

Synthesize & Write

Synthesis Agent detects gaps in gesture analysis post-Räisänen (2020), flags contradictions between Jones and Norris (2005) action discourse and recent digital studies. Writing Agent applies latexEditText and latexSyncCitations for multimodal framework papers, uses latexCompile for reports with exportMermaid diagrams of semiotic modes.

Use Cases

"Extract code or data from papers on multimodal meme analysis for Python visualization."

Research Agent → paperExtractUrls on Yoon (2016) → paperFindGithubRepo → githubRepoInspect → runPythonAnalysis (matplotlib plots of meme ideologies).

"Compile a LaTeX review of multimodality in TED talks and lectures."

Synthesis Agent → gap detection in Xia (2021) and Crawford (2015) → latexEditText draft → latexSyncCitations → latexCompile PDF with diagrams.

"Find GitHub repos linked to multimodal discourse tools in business communication papers."

Research Agent → searchPapers 'Räisänen multimodal meetings' → Code Discovery (paperExtractUrls → paperFindGithubRepo → githubRepoInspect for gesture tracking scripts).

Automated Workflows

Deep Research workflow scans 50+ papers via searchPapers on 'multimodal discourse education', structures report with TESOL guidelines (Mahboob et al., 2016) and meme analyses. DeepScan applies 7-step CoVe to verify ideology claims in Yoon (2016) against foundational Jones and Norris (2005). Theorizer generates semiotic theory from Zhang (2017) websites and Hu (2016) ads.

Try Doxa for Multimodal Discourse Analysis Research

Frequently Asked Questions

What defines Multimodal Discourse Analysis?

It analyzes integration of textual, visual, gestural, and auditory modes in discourse meaning-making, extending Kress-van Leeuwen frameworks.

What methods are used?

Methods include Systemic Functional Linguistics for visuals (Hu and Luo, 2016), rhetorical arena theory for memes (Pulos, 2020), and genre analysis for websites (Zhang, 2017).

What are key papers?

Yoon (2016, 134 citations) on racist memes; Crawford (2015, 49 citations) on academic lectures; Xia and Hafner (2021, 36 citations) on TED engagement.

What open problems exist?

Challenges include quantifying visual ideologies (Yoon, 2016), integrating modes in digital genres (Xia and Hafner, 2021), and adapting to business lingua franca (Räisänen, 2020).