• The Five Modes Explained
• Multi-Modal Considerations

As writers, we make choices. In every situation, we must decide how to best communicate meaning to our intended audiences. It is a process of deliberation that involves calculated choices, strategies, and moves. And, nowadays, writing isn’t just putting words onto paper anymore.

“Multi-modal” assignments have become common in higher education, and it is likely that you will be asked to create multi-modal texts during your academic career. In the field of writing/composition, “modality” is a rhetorical decision that you need to consider as you explore how to best achieve your intended purpose(s).

A multi-modal text employs more than one “mode” to communicate meaning beyond the written word alone. According to the New London Group, these are the five modes:

Why would writers want to communicate in a modality other than alphabetic text? We’ve all heard the saying that “a picture is worth 1000 words.” In certain situations, a visual has the potential to convey an idea more effectively and more quickly than written text. Images can help readers to better engage with the topic and experience a moment in a way that could be more difficult to accomplish with words alone.

THE FIVE MODES EXPLAINED

Ann Fillmore

Modality is an important rhetorical decision that writers need to consider. Here’s a more detailed look into each mode of communication. Modes can be used individually and in combination with others to create multi-modal texts.

1. Linguistic/Alphabetic Mode: includes written and spoken words, word choice, vocabulary, grammar, structure, and organization of sentences and paragraphs

Writers use words to communicate. This mode is the most widely used, is a form that most people are familiar with, and can be delivered through print and audio.

Shopping lists, emails, text messages, academic essays, and the automated voice you hear as you’re on hold with customer service use the linguistic/alphabetic mode since they rely on words to create meaning.

2. Visual Mode: includes images, video, color, visual layout, design, font, size, formatting, symbols, visual data (charts, graphs), animation (like gifs)

The visual mode helps writers communicate meaning in a way that can be seen by the audience. Sometimes people must see to believe, and visuals can be helpful and even persuasive. For example, if you want to showcase how climate change has devastated the arctic ecosystem, you might include a video that shows real-world footage, like this one by National Geographic. This video is considered a multi-modal text since words, visuals, and audio are used together for a stronger effect.

https://youtube.com/watch?v=_JhaVNJb3ag%3Ffeature%3Doembed%26rel%3D0

The visual mode also includes elements of design and allows writers a more creative way to present text on a page/screen. For example, the textbook in the photo below makes use of labels, headings, color, and other visual features to help the reader more easily understand the information. This textbook is considered multi-modal since it combines multiple modes of communication.

3. Aural Mode: includes spoken words, sound, music, volume, rhythm, speed of delivery, pitch, tone, voice

Sound catches people’s attention, and writers use the aural mode to bring their words to life. For example, have you ever listened to a game on the radio? Listen to the way the sportscasters help the audience to experience the game through sound. This sportscast is considered a multi-modal text since the authors combine words (linguistic/alphabetic mode) with sound (aural mode).

https://youtube.com/watch?v=GEKHVp4LTTw%3Ffeature%3Doembed%26rel%3D0

Another example of the aural mode is an audio book. Listen to the following excerpt from The Carriage, by Jena Baxter. Spoken words can add depth and emotion to a story. As you listen, pay attention to the volume, rhythm, pitch, speed, and tone of the narrator’s voice. Multi-modality can enhance the experience of “reading” a text.

https://youtube.com/watch?v=CxJwT8myN4o%3Ffeature%3Doembed%26rel%3D0

4. Gestural Mode: includes movement, speed, expression, body language, facial expression, physical proximity, interactions between people

The gestural mode of communication allows writers to communicate meaning through movement. Traditionally, this mode was used primarily in face-to-face interaction; however, modern technology allows writers to show movement virtually in their work, through video. The gestural mode is often used in combination with other modes, such as linguistic/alphabetic (written/spoken), spatial (physical arrangement), and aural (sound) to provide an enhanced sensory experience for the audience.

For example, sign languages use the gestural mode since position of the sign and movement are significant factors in generating and distinguishing meaning. In this video, look at how the speakers use movements of the hands, head, face, and body, along with position and speed, to communicate meaning to the audience. Sign languages are considered multi-modal communication since they combine linguistic/alphabetic text with movement.

https://youtube.com/watch?v=dmsqXwnqIw4%3Ffeature%3Doembed%26rel%3D0

5. Spatial Mode: includes physical arrangement―spacing, position, organization, proximity, direction, and distance of elements in a text

Writers use the spatial mode of communication in the physical layout and organization of a text. For example, this tri-fold pamphlet, printed and folded on paper, presents information spatially on six panels. Physical arrangement impacts the way the audience can interact with your work.

Websites also rely heavily on the spatial mode to communicate meaning. Writers make strategic rhetorical decisions about how to arrange digital information in a user-friendly way within a mobile “space.” Features like menus, headers, physical layout, and navigation tools (such as links) help the audience to interact with the site spatially. Websites are considered multi-modal texts since multiple modes are used in combination to communicate with the audience.

Take a few minutes to browse the SLCC website. As you explore, pay attention to how the authors arrange the information within the digital space. What does this communicate to the reader? How does the spatial arrangement enhance or hinder the user experience? These are important rhetorical decisions to consider as you work.

MULTI-MODAL CONSIDERATIONS

Now that you have a further understanding of the five modes of communication and how they work individually and in combination, how can you apply them into your writing?

Start by researching the rhetorical situation. It is essential that you have a firm understanding of the purpose, audience, and context surrounding the writing task. Understanding the rhetorical situation will help you to make decisions as to which mode or combination of modes might best help you to connect with your intended audience.

As the writer, you’ll need to determine which modes could add value to your work. Be careful not to add modes just because you think you should. Each mode you use should add meaning to the text. Consider the opportunities, challenges, and constraints of any writing task and assess and revise your work to meet the needs of the audience.

In conclusion, modality affects how the audience will interact with and generate meaning from your work. Writing in the five modes can help you to think “outside the box” as you make rhetorical decisions about the kinds of communication that you could use as you venture beyond the printed word.

*Note: Original section authors are indicated under section headings

Works Cited

Lutkewitte, Claire, editor. Multimodal Composition: A Critical Sourcebook. Bedford/St. Martin’s, 2014.

All photos labeled for reuse unless otherwise noted.

READING TRADITIONAL AND NEW MEDIA

Throughout college, you will be asked to read and respond to a variety of books, essays, articles, and other texts.  However, some classes may ask you to read and respond to different types of traditional media such as visual art, graphic novels, music, television, films, and radio or even new media such as websites, infographics, social media platforms, podcasts, and Youtube videos. Though we may not always be conscious of it, many of us are already engaged in an understanding of culture through various forms of media; we interact daily with all kinds of media and then spend social time discussing our thoughts and reactions to them.  ‘Reading’ media makes use of our existing cultural knowledge while engaging our critical thinking and analysis skills.  Applying critical reading skills to traditional and/or new media can differ from reading a traditional text such as an academic essay, however.  Here is a three step process that you can use to analyze media:

1. Describe the literal content of the media object.

Content is the literal information being communicated by a media object.  This might mean describing the types of sounds or lyrics in a song, the setting and characters in a film or television show, or images from a piece of a visual art.  Think of describing the content as summarizing the information in an object as opposed to interpreting the information.  Use straightforward statements to avoid interpretation. For example, you might describe an exhibit in a modern art museum as such: This picture focuses on a bridge and a river.  There are two people standing on the bridge.  Using simpler statements will help keep the content and form of the object separate.

2. Explain the form of the media object.

Formal qualities of a media object are the delivery system for an object’s content.  To discuss the form of an object, you will need to consider the way the object has been organized and how to describe that organization.  Think of this as describing the ‘shape’ of the new media object.  To do this, use descriptive statements that explain how an object appears.  Let’s return to the picture from before.  The painting is very large and takes up the entire wall.  It is made of many bright, unnatural colors, and appears to be made with a computer instead of a paintbrush.  Your description should aim to explain how the object is being presented to the audience.

3. Synthesize content and form.

Once you have generated some ideas about the information in the media object (Content) and how that information is presented (Form), you can synthesize the two by combining your observations into a claim about the object.  A good starting point is to consider what the goals of the creator may have been: Why did the author present this content in this form?  Answering your own questions will help guide you towards a more complete understanding of the object.  From here, you can begin to draft a thesis statement about the purpose and meaning of the media object you are analyzing.

Reading media will help you to think critically about what the object is trying to communicate and how it influences you as a reader.  Analyzing media can also help you explore and understand your identity as an individual or a student and how that relates to the culture surrounding you.  However, while writing about various forms of media, remember to reference evidence from the object, as there will otherwise be no basis for your claims.  Your evidence will, if you are analyzing a film, you may need to cite dialogue or reference the cinematic techniques of a scene as evidence for your conclusions about the meaning of the film.  For a piece of music, lyrics, instrumentation, or the structure of the song may be the evidence you include.  Once you have completed this process, you should review the object to ensure your claims about the meaning of the piece are supported by your observations on the content and form.