Multimodality and context: problems, assumptions and hypotheses

Authors

DOI:

https://doi.org/10.22168/2237-6321-32536

Keywords:

Stratification. Realization. Contextual parameter.

Abstract

Drawing on the paradigmatic and sociosemiotic orientation provided by Systemic Functional Theory, this paper explores the following question: assuming a mutually constitutive relationship between text and context of situation, how does this play out in multimodal artifacts? For example, can an image realize the same cultural elements as a verbal instance (and vice versa)? To suggest possible answers, we will examine how the global dimensions of stratification, instantiation and metafunction can make explicit the elements that are at play when framing the relationship between language and context, as well as the consequences of such ideas for understanding multimodality as a sociosemiotic phenomenon. This is followed by an analytical illustration and, finally, by concluding remarks on issues that future research may address.

Author Biography

  • Theodoro C. Farhat, Universidade de São Paulo.
    Bacharel em Letras (português e linguística) pela Faculdade de Filosofia, Letras e Ciências Humanas da Universidade de São Paulo.

References

BATEMAN, J. A.; WILDFEUER, J.; HIIPPALA, T. Multimodality – Foundations, Research and Analysis: A Problem-Oriented Introduction. Berlim: Walter de Gruyter, 2017.

BOURDIEU, P. A distinção: crítica social do julgamento. Porto Alegre: Zouk, 2007.

BOWCHER, W. L. Material action as choice in field. In: FONTAINE, L.; BARTLETT, T.; O’GRADY, G. (eds.). Systemic Functional Linguistics: Exploring Choice. Cambridge: Cambridge University Press, 2013. p. 318–341.

BOWCHER, W. L. Issues for Developing Unified Systems for Contextual Field and Mode. Functions of Language, v. 21, n. 2, p. 176–209, 2014.

BROWN, P.; LEVINSON, S. C. Politeness: Some universals in language usage. New York: Cambridge University Press, 1987.

FARHAT, T. C.; GONÇALVES-SEGUNDO, P. R. Análise multimodal: noções e procedimentos fundamentais. Trabalhos em Linguística Aplicada, v. 61, p. 435-454, 2022.

FARHAT, T. C.; GONÇALVES-SEGUNDO, P. R. Entre o falar e o fazer: AÇÃO VERBAL e AÇÃO MATERIAL como parâmetros contextuais. Submetido para publicação.

FIGUEREDO, G. P. Introdução ao perfil metafuncional do português brasileiro: contribuições para os estudos multilíngues. 2011. Tese (Doutorado em Linguística Aplicada) – Faculdade de Letras, Universidade Federal de Minas Gerais, Belo Horizonte, 2011.

FORCEVILLE, C. Visual and Multimodal Communication: Applying the Relevance Principle. Oxford: Oxford University Press, 2020.

FUZER, C.; CABRAL, S. R. S. Introdução à gramática sistêmico-funcional em língua portuguesa. Campinas: Mercado de Letras, 2014.

HALL, E. T. The Hidden Dimension. New York: Doubleday, 1966.

HALLIDAY, M. A. K. Learning how to mean: Explorations in the Development of Language. London: Edward Arnold, 1975.

HALLIDAY, M. A. K. Modes of meaning and modes of expression: types of grammatical structure and their determination by different semantic functions. In: ALLERTON, D. J.; CARNEY, E.; HOLDCROFT, D. (eds). Function and context in linguistic analysis: a Festschrift for William Haas. Cambridge: Cambridge University Press, 1979. p. 57–79

HALLIDAY, M. A. K.; MATTHIESSEN, C. M. I. M. Introduction to Functional Grammar. 4a ed. New York/London: Routledge, 2014.

HASAN, R. Speaking with reference to context. In: GHADESSY, M. (ed.) Text and Context in Functional Linguistics. Amsterdam: John Benjamins, 1999. p. 219-328.

HASAN, R. The place of context in a systemic functional model. In: HALLIDAY, M. A. K.; WEBSTER, J. (eds.) Continuum Companion to Systemic Functional Linguistics. London: Continuum International, 2009. p. 166-189.

HASAN, R. Towards a paradigmatic description of context: systems, metafunctions, and semantics. Functional Linguistics, v. 1, n. 1, p. 1-54, 2014.

HASAN, R. Tenor: Rethinking interactant relations. Language, Context and Text, v. 2, n. 2, p. 213–333, 2020.

KALANTZIS, M.; COPE, B. Adding Sense: Context and Interest in a Grammar of Multimodal Meaning. Cambridge: Cambridge University Press, 2020.

KRESS, G. Multimodality: A social semiotic approach to contemporary communication. Oxon: Routledge, 2010.

KRESS, G.; VAN LEEUWEN, T. Reading Images: The Grammar of Visual Design. 2a ed. London/New York: Routledge, 2006.

MARTIN, J. R. English Text: System and Structure. Philadelphia: John Benjamins, 1992.

MARTIN, J. R.; ROSE, D. Working with Discourse: Meaning beyond the clause. 2a ed. Continuum: London, 2007.

MATTHIESSEN, C. M. I. M. Multisemiosis and context-based register typology: Registerial variation in the complementarity of semiotic systems. In: VENTOLA, E.; GUIJARRO, A. J. M. (eds.). The World Told and the World Shown: Multisemiotic Issues. Palgrave Macmillan, London, 2009. p. 11-38.

MATTHIESSEN, C. M. I. M. Modelling context and register: The long-term project of registerial cartography. Letras, v. 25, n. 50, p. 15-90, 2015.

NASCIMENTO, R.; BEZERRA, F.; HEBERLE, V. Multiletramentos: iniciação à análise de imagens. Linguagem & Ensino, v. 14, n. 2, p. 529-552, jul./dez. 2011.

Published

2023-01-30

Issue

Section

2022.3: Multimodalidade em práticas sociais

How to Cite

Multimodality and context: problems, assumptions and hypotheses. Entrepalavras, [S. l.], v. 12, n. 3, p. 38–61, 2023. DOI: 10.22168/2237-6321-32536. Disponível em: https://periodicos.ufc.br/entrepalavras/article/view/99663. Acesso em: 21 sep. 2026.