Skip to Main Content

How to do a Video Essay: Modes Of Multimodality

An introduction to the video essay

Visual Representation - PICTURES/VIDEO

Visual Representation used for meaning-making involves the viewer seeing the whole picture all at once. It is used as a design element and is the representation of space in time. Visual meaning is growing in significance in todays society and is increasingly used for communication. The use of screens sees the modes of text and visual meaning come together.

Visual Representation

Audio Representation - SOUNDS

Audio Representation is sound as spoken words, sound, sound effects, ambient noise, music, silence and involves pitch, volume and rhythm.

image:www.themusicofalexthode.com/about/

Spatial Representation - PLACEMENT

Spatial Representation is the interaction with spaces including buildings, landscapes, geographic locations and ecosystems. Making sense of space and the ability to attribute meaning to them.

Oral Representation - SPEECH

Oral Representation of language or speech is a medium of communication coded in sound which is ephemeral. Oral language can be spontaneous (casual dialogue) or planned (speech). In multimodality, speech and writing are treated as separate modes as they refer to different sets of semiotic resources.

Written Representation - WORDS

Written Representation as language is a mode of communication using coded symbols. Writing is fixed and can be spontaneous or planned. In multimodality, speech and writing are treated as separate modes as they refer to different sets of semiotic resources.

Gestural Representation - MOVEMENT

Gestural Representation includes movement, speed, stillness, body language and facial expression. Gestural, spatial and tactile concepts are closely connected. 

Tactile Representation - TOUCH/FEEL

Tactile Representation is the interaction with objects. This mode is interconnected with Spatial, Tactile and Gestural modes to create meaning.

Tactile Representation
image: samanthagrover.co.uk/reveal/