Multimodal and cognitive approaches to academic discourse in AI-supported learning
DOI:
https://doi.org/10.26565/2218-2926-2025-30-02Keywords:
academic discourse, artificial intelligence, autonomy, cognition, digital literacy, multimodal learningAbstract
This article examines how academic discourse is reshaped in higher education through the integration of artificial intelligence (AI) and multimodal design, understood here in the sense of multimodal discourse theory (not multimodal AI models). Grounded in cognitive linguistics, sociocognitive discourse theory and multimodal semiotics, the study analyzes how academic concepts are structured and communicated in AI-enhanced learning environments. It focuses on two Micromodules developed at the University of Osnabrück – Welcome to the AI Jungle and Expedition AI. Micromodules are short multimedia units suitable for Blended Learning that integrate text, visuals, interactivity, and AI-generated feedback within the Stud.IP Learning Management System (LMS). Using a combination of cognitive discourse analysis and multimodal content analysis, the study explores how learners engage with the concepts of learning, argumentation, and autonomy in AI-mediated contexts.
Our findings show that learners navigate content using conceptual metaphors like LEARNING IS A JOURNEY, reinforced by modular layout and AI feedback mechanisms. Argumentation is shaped through additive elaboration rather than critical opposition, while autonomy is bounded by interface cues and AI prompts. The study also analyzes how AI systems – specifically tailored to and embedded within the LMS – can participate as semiotic agents, influencing meaning-making through tone, visual presence, and structured interaction. These patterns suggest a shift toward dialogic, hybrid academic discourse in which agency is distributed across human and non-human actors. The article argues that in AI-supported, multimodal learning environments, academic literacy should be reimagined as something created through collaboration between students, educators, and digital tools. It also highlights that developing critical digital literacy is essential for designing curricula that meet the demands of the future.
Downloads
Published
Issue
Section
License
Authors, who publish with this journal, accept the following conditions:
The authors reserve the copyright of their work and transfer to the journal the right of the first publication of this work under the terms of the Creative Commons Attribution License (CC BY), which allows other persons to freely distribute a published work with mandatory reference to the authors of the original work and the first publication of the work in this journal.
Authors have the right to enter into separate additional agreements for the non-exclusive dissemination of the work in the form in which it was published by this journal (for example, to post the work in the electronic institutions' repository or to publish as part of a monograph), provided that the link to the first publication of the work in this journal is given.
The journal policy allows and encourages the authors to place the manuscripts on the Internet (for example, in the institutions' repositories or on personal websites), both before the presentation of this manuscript to the editorial board and during review procedure, as it contributes to the creation of productive scientific discussion and positively affects the efficiency and dynamics of citing the published work (see The Effect of Open Access).
