Video Games and Multimodality: Exploring Interfaces and Analyzing Video Screens Using the GeM Model

Dušan Stamenković, Milan Jacevic

Publications: Chapter in Book/Report/Conference proceedingBook chapterResearchpeer-review


With the purpose of showing that video game studies should become part of the emerging discipline of multimodality, the present chapter introduces the basics of the study of gameworlds and uses the multimodal document approach to analyze document-like screens coming from two video games: Football Manager 2018 and Europa Universalis IV. These document-like screens are analyzed using the tools coming from the GeM model, which treats these pages as multi-layered semiotic artifacts. Within this approach, all four layers are covered: the base layer, the layout layer, the rhetorical layer, and the navigation layer. Our analysis proposal tries to pinpoint the semiotic specificities of the different layers and test whether the GeM model needs to be adapted for the purpose of approaching these screens. At the same time, the gameworld environment is viewed as an important mediator between the player and the digital game system. We hope that such integrated approach can be beneficial to both multimodality and video game studies and expand the directions of future research endeavors.
Original languageEnglish
Title of host publicationMultimodality : Disciplinary Thoughts and the Challenge of Diversity
EditorsJanina Wildfeuer, Jana Pflaeging, John Bateman, Ognyan Siezov, Chiao-I Tseng
PublisherDe Gruyter
Publication dateNov 2019
ISBN (Electronic)9783110608694
Publication statusPublished - Nov 2019


  • multimodality
  • video games
  • documents
  • gameworlds
  • screens
  • GeM model

Artistic research

  • No

Cite this