This collection responds to the need for theoretically informed and methodologically grounded empirical research on the global transformations in multimodal human communication and social practices in light of recent widespread change. The volume highlights the need to expand on the established approaches--Social Semiotics, Multimodal Discourse Analysis, and Multimodal (Inter)action Analysis--by complementing them with other analytical frameworks to better understand the impact of unprecedented global challenges, such as Covid-19, on the way humans communicate and make use of meaning-making resources. Bringing together established and emergent scholars from a variety of geographical, cultural, and linguistic contexts, the collection presents studies from both the Global North and Global South, including South Africa, Latin America, Brazil, and the Caribbean, to showcase new perspectives in multimodality research. This innovative book will be of interest to students and scholars in multimodality, social semiotics, and discourse analysis.

This collection critically considers the question of how learning and teaching should be conceived, understood, and approached in light of the changing nature of learning scenarios and new pedagogies in this current age of multimodal digital texts, practices, and communities. The book takes the concept of digital artifacts as being composed of multiple meaning-making semiotic resources, such as visuals, music, and design, as its point of departure to explore how diverse communities interact with these tools and develop and explore their understanding of digital practices in learning contexts. The first section of the volume examines different case studies in which involved participants learn to grapple with the introduction of digital tools for learning in children’s early years of schooling. The second section extends the focus to secondary and higher education settings as digital learning tools grow more complex as do students, parents, and teachers’ interactions with them and the subsequent need for new pedagogies to rethink these multimodal artifacts. A final section reflects on the implications of new multimodal tools, technologies, and pedagogies for teachers, such as on teacher training and community building among educators. In its in-depth look at multimodal approaches to learning as meaning-making in a digital world, this book will be of interest to students and scholars in multimodality, English language teaching, digital communication, and education.

This volume presents innovative research on the multimodal dimension of discourse specific to academic settings, with a particular focus on the interaction between the verbal and non-verbal in constructing meaning. Contributions by experienced and emerging researchers provide in-depth analyses in both research and teaching contexts, and consider the ways in which multimodal strategies can be leveraged to enhance the effectiveness of academic communication. Contributors employ both quantitative and qualitative analytical methods, and make use of state-of-the-art software for analyzing multimodal features of discourse. The chapters in the first part of the volume focus on the multimodal features of two key research genres: conference presentations and plenary addresses. In the second part, contributors explore the role of multimodality in the classroom through analyses of both instructors’ and students’ speech, as well as the use of multimodal materials for more effective learning. The research presented in this volume is particularly relevant within the context of globalized higher education, where participants represent a wide range of linguistic and cultural backgrounds. Multimodal Analysis in Academic Settings contributes to an emerging field of research with importance to an increasing number of academics and practitioners worldwide.

Contemporary society has witnessed radical changes in the field of communications in terms of how messages and meanings are disseminated. Digitalization and the Internet have signalled an exponential rise in the circulation of multimodal texts in which different semiotic resources are orchestrated together to construct meaning in all areas of social life, across languages and cultures, and in diverse specialized discourse domains. This has foregrounded the need to examine the semiotic functions, affordances, and issues at stake in a range of multimodal discourse forms, while simultaneously highlighting the importance of critical multimodal literacy in audiences and learners. This volume develops and extends pioneering research on the intersection between multimodality and specialized discourse. Eight newly commissioned studies offer innovative perspectives on multimodal research methodologies and applications in a variety of ESP (English for Specific Purposes) contexts for practitioners and scholars alike. The volume offers a glimpse at future directions in this dynamic and ever-evolving area of investigation focusing on the synergy between verbal and non-verbal modes of communication in the digital age. Each chapter explores an original area of application: academic, economic, scientific, marketing, legal, medical, political, and tourism. The contributors approach multimodality from a range of theoretical and methodological viewpoints including synchronic and diachronic corpus-based and corpus-aided studies, critical discourse analysis, and systemic functional linguistics. Analytical tools such as multimodal (critical) discourse analysis, multimodal transcription, and multimodal annotation software capable of representing the interplay of different semiotic modes - speech, intonation, direction of gaze, facial expressions, gesturing, and spatial positioning of interlocutors - are employed. The diversity of research strands contained in the volume illustrates just some of the vast areas of multimodal knowledge dissemination that are still unmapped. As a cornerstone of communication, multimodality needs exploring in all its facets. These contributions aim to further that cause.

This practical analytical guide to classroom languaging dynamics in L2 tertiary classrooms integrates multimodality, sociological theory of education and ecosocial semiotic perspectives. It offers a theoretical and methodological framework for conducting multimodal analysis of meaning-making processes in different pedagogical settings. The multimodal investigation of real-time classroom interactivity showcases an embodied coordination of vocalization and gesticulation in classroom interactions, where it varies from students’ solo speech in individual presentations, to teacher-student interactions in group discussions, and to student-student interactions in role-play. With a unified conceptual framework articulating both the macro and micro analysis, this book proposes more ecological-based approaches to language and unpacks a multi-scalar analytical framework to open up for an embodied analysis of meaning-making processes in multimodal interaction analysis. The rich systematic analysis built upon the ecosocial semiotic approach illustrates in practice how theoretical frameworks link to empirical data analysis through exemplified analytical processes and practices, and demonstrates the value of how multimodal interaction analysis contributes to the understanding of the cognitive dynamics of languaging activities that take place in L2 educational contexts. The book provides not only a practical methodological guide to multimodal interaction analysis, but also hands-on analytical references to multimodal classroom research in the field. In addition to early career scholars and PhD students, this volume will be valuable for international academics looking for complementary frameworks or approaches to multimodality, particularly in the L2 Asian contexts.

The Discourse of YouTube explores the cutting edge of contemporary multimodal discourse through an in-depth analysis of structures, processes and content in YouTube discourse. YouTube is often seen as no more than a place to watch videos, but this book argues that YouTube and YouTube pages can also be read and analysed as complex, multi-authored, multimodal texts, emerging dynamically from processes of textually-mediated social interaction. The objective of the book is to show how multimodal discourse analysis tools can help us to understand the structures and processes involved in the production of YouTube texts. Philip Benson develops a framework for the analysis of multimodality in the structure of YouTube pages and of the multimodal interactions from which their content emerges. A second, and equally important, objective is to show how the globalization of YouTube is central to much of its discourse. The book identifies translingual practice as a key element in the global discourse of YouTube and discusses its roles in the negotiation of identities and intercultural learning in videos and comments. Focusing on YouTube as a key example of new digital media, The Discourse of YouTube makes a substantial contribution to conversations about new ways of producing multimodal text in a digital world.

A first in multimodal/multisemiotic discourse studies this collection of original articles by international scholars focuses primarily on texts from non-English speaking contexts. The illuminating insights enhance our understanding of how language and other semiotic resources construe specific cultural and social concerns.

Over the past three decades, our conceptualizations of literacy and what it means to be literate have expanded to include recognition that there is a qualitative difference in how we communicate through modalities such as the visual, audio, spatial, and linguistic and that different modes are combined in complex ways to make meaning. The field of multimodality is concerned with how human beings use different modes of communication to represent or make meaning in the world. Despite the rapid growth of international research in this area, accounts of a broader range of global sites, particularly economically under-resourced and culturally diverse contexts such as Sub-Saharan Africa, remain under-researched and under-represented in the literature. This book contextualizes a range of literacies including health literacies, community literacies, family literacies, and multilingual literacies within broader modes of communication, most specifically play and the visual. The claim is that powerful pedagogies, methodologies and theories can be constructed by taking a more detailed look at multimodal meaning-making in diverse contexts. By describing and analyzing multimodal practices and texts across a diverse range of contexts, the book highlights different constructs, issues and emerging questions dealing with the study of literacies and multimodality.

Multimodality is one of the most popular and influential semiotic theories for analysing media. However, the application and conceptual anchoring of multimodality often remains geographically and disciplinarily grounded within local systems of thought. New Studies in Multimodality combines the expertise of multimodalists from around the globe, offering novel readings and applications of central concepts in multimodality and inviting innovative synergies between previously disparate schools. Combining perspectives from the most actively developing traditions of theory and research, this book progresses from classic concepts to more empirically and practice-motivated contributions. Contributors engage in mutual dialogue to present new theoretical perspectives and compelling applications to a variety of old and new media. Expanding the basis and scope of multimodality, this volume shows awareness and experience of this field in many disciplines and illustrates how versatile, pervasive and relevant it is for studying today's communication phenomena.

The phenomenon of multimodality has, as Jewitt observes, generated interest "across many disciplines...against the backdrop of considerable social change." Contemporary societies are grappling with the social implications of the rapid increase in sophistication and range of multimodal practices, particularly within interactive digital media, so that the study of multimodality also becomes essential within an increasing range of practical domains. As a result of this increasing interest in multimodality, scholars, teachers and practitioners are on the one hand uncovering many different issues arising from its study, such as those of theory and methodology, while also exploring multimodality within an increasing range of domains. Such an increase and range of interest in multimodality heralds the emergence of a distinct multimodal studies field: as both the mapping of a domain of enquiry, and as the site of the development of theories, descriptions and methodologies specific to and adapted for the study of multimodality. The present volume presents a range of works by an impressive international roster of contributors who both explore issues arising from the study of multimodality and explore the scope of this emerging field within specific domains of multimodal phenomena. Contributors aim to show that each individual work and works in general within multimodal studies represent a dialectic or complementarity between the exploration of issues of general significance to multimodal studies and the exploration of specific domains of multimodality; while characterizing specific works as tending to some degree towards one or other of these main areas of focus. Such a characterization is seen as part of a move towards the identification and thus development of a distinct field of multimodal studies.