This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (9) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Hull, G. A. Articles by Nelson, M. E. Search for Related Content Social Bookmarking                         What's this?

Locating the Semiotic Power of Multimodality

University of California, Berkeley

Mark Evan Nelson

University of California, Berkeley

This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world contexts, and they offer one example of how such investigations might be approached. Drawing on data from the practice of multimedia digital storytelling, specifically a piece titled "Lyfe-N-Rhyme," created by Oakland, California, artist Randy Young (accessible at http://www.oaklanddusty.org/videos.php), the authors detail the method and results of a fine-grained multimodal analysis, revealing semiotic relationships between and among different, copresent modes. It is in these relationships, the authors argue, that the expressive power of multimodality resides.

Key Words: multimodal texts • semiotics • multiliteracies • New London Group • multimedia • digital stories

Written Communication, Vol. 22, No. 2, 224-261 (2005)
DOI: 10.1177/0741088304274170


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				P. Smagorinsky The Cultural Practice of Reading and the Standardized Assessment of Reading Instruction: When Incommensurate Worlds Collide Educational Researcher, October 1, 2009; 38(7): 522 - 527. [Abstract] [Full Text] [PDF]

				C. Greenhow, B. Robelia, and J. E. Hughes Learning, Teaching, and Scholarship in a Digital Age: Web 2.0 and Classroom Research: What Path Should We Take Now? Educational Researcher, May 1, 2009; 38(4): 246 - 259. [Abstract] [Full Text] [PDF]

				G. Hull, J. Zacher, and L. Hibbert Youth, Risk, and Equity in a Global World Review of Research in Education, March 1, 2009; 33(1): 117 - 159. [Full Text] [PDF]

				L. Vasudevan and G. Campano The Social Production of Adolescent Risk and the Promise of Adolescent Literacies Review of Research in Education, March 1, 2009; 33(1): 310 - 353. [Full Text] [PDF]

				M. E. Nelson, G. A. Hull, and J. Roche-Smith Challenges of Multimedia Self-Presentation: Taking, and Mistaking, the Show on the Road Written Communication, October 1, 2008; 25(4): 415 - 440. [Abstract] [PDF]

				K. Lundby Editorial: mediatized stories: mediation perspectives on digital storytelling New Media Society, June 1, 2008; 10(3): 363 - 371. [PDF]

				J. Ranker Composing Across Multiple Media: A Case Study of Digital Video Production in a Fifth Grade Classroom Written Communication, April 1, 2008; 25(2): 196 - 234. [Abstract] [PDF]

				V. L. Gadsden The Arts and Education: Knowledge Generation, Pedagogy, and the Discourse of Learning Review of Research in Education, February 1, 2008; 32(1): 29 - 61. [Full Text] [PDF]

				M. Sperling and A. Dipardo English Education Research and Classroom Practice: New Directions for New Times Review of Research in Education, February 1, 2008; 32(1): 62 - 108. [Full Text] [PDF]