MULTIMODALITY IN ACADEMIC LANGUAGE: ASPECTS OF THE LEXICOGRAMMAR OF PRESENTATION SLIDES

Vol.7,No.2(2014)

Abstract
The paper approaches academic talks or conference presentations (CPs) as a researchprocess genre which is based on the interplay of the written and spoken modes. The aim of the study is twofold: (1) it attempts to present an in-depth overview of research on multimodality in relation to academic language, and (2) it offers a (mostly quantitative) analysis of slides from PowerPoint presentations. The slides are approached as a platform for the study of so-called visual lexicogrammar. The research is rooted in Halliday’s systemic-functional framework involving the concept of language functions; it also draws on the genre-based approach to discourse analysis (Bhatia 1993, Martin 1997, Swales 1990, 2004) and multimodal theory as elaborated by Iedema (2003), Kress and van Leeuwen (2006) and O’Halloran and Smith (2011). The findings suggest that the visual lexicogrammar is realized through the interplay of visual and scriptural images; scriptural images dominate over visual images, primarily performing a discourse-structuring role in the slides by signalling the ‘IMRAD’ stages.

Keywords:
academic discourse; conference presentation; multimodality; research-process genre; visual lexicogrammar; visual paragraph; visual coding images; text slides
References

Bhatia, V. K. (1993) Analysing Genre. Language Use in Professional Settings. London
and New York: Longman.


Carter-Thomas, S. and Rowley-Jolivet, E. (2003) ‘Analysing the scientific conference
presentation (CP). A methodological overview of a multimodal genre.’ ASp 39-40.


Halliday, M. A. K. (1978) Language as Social Semiotic. London: Edward Arnold.


Iedema, R. (2003) ‘Multimodality, resemiotization: Extending the analysis of discourse as
multi-semiotic practice.’ Visual Communication 2/1, 29-57. https://doi.org/10.1177/1470357203002001751


Jewitt, C. (ed.) (2009) The Routledge Handbook of Multimodal Analysis. London:
Routledge.


Kress, G. (2010) Multimodality: A Social Semiotic Approach to Contemporary
Communication. London: Routledge.


Kress, G. and van Leeuwen, T. (2006) Reading Images: The Grammar of Visual Design.
2nd ed. New York: Routledge.


Lemke, J. (1998) ‘Multiplying meaning: Visual and verbal semiotics in scientific text.’ In:
Martin, J. R. and Veel, R. (eds) Reading Science. London: Routledge. 87-113.


Martin, J. R. (1997) ‘Analysing genre: Functional parametres.’ In: Christie, F. and Martin,
J. R. (eds) Genre and Institutions. Social Processes in the Workplace and School.
London and New York: Continuum. 3-39.


O’Halloran, K. L. and Smith, B. A. (eds) (2011) Multimodal Studies: Exploring Issues
and Domains. London: Routledge.


O’Halloran, K. L. (in print) ‘Multimodal analysis and digital technology.’ Online document.
February 2014. <http://multimodal-analysis-lab.org/_docs/Multimodal%20Analysis
%20and%20Digital%20Technology.pdf>.


Rowley-Jolivet, E. (2002) ‘Visual discourse in scientific conference papers: A genrebased
study.’ English for Specific Purposes 21/1, 19-40.


Rowley-Jolivet, E. (2012) ‘Oralising text slides in scientific conference presentations.’
In: Boulton, A., Carter-Thomas, S. and Rowley-Jolivet, E. (eds) Corpus-Informed
Research and Learning in ESP. Amsterdam: John Benjamins. 137-165.


Scollon, R. and Scollon, S. W. (2009) ‘Multimodality and language. A retrospective
and prospective view.’ In: Jewitt, C. (ed.) The Routledge Handbook of Multimodal
Analysis. London: Routledge. 170-180.


Swales, J. M. (1990) Genre Analysis: English in Academic and Research Settings.
Cambridge: Cambridge University Press.


Swales, J. M. (2004) Research Genre: Explorations and Applications. Cambridge:
Cambridge University Press.


Tomášková, R. (2012) ‘Frequently asked questions: A genre between centre and periphery.’
Ostrava Journal of English Philology 4, 117-132.


van Leeuwen, T. (2011) The Language of Colour: An Introduction. London: Routledge.

Metrics

407

Views

256

PDF views