Multimodality : foundations, research and analysis : a problem-oriented introduction

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specific...

Full description

Saved in:
Bibliographic Details
Main Authors Bateman, John A., Wildfeuer, Janina, Hiippala, Tuomo
Format eBook Book
LanguageEnglish
Published Berlin De Gruyter Mouton 2017
De Gruyter
De Gruyter, Inc
Edition1
SeriesMouton Textbook
Subjects
Online AccessGet full text

Cover

Loading…
Abstract This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today's increasingly complex combinations of multimodal artefacts and performances of all kinds.
AbstractList This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today's increasingly complex combinations of multimodal artefacts and performances of all kinds.
Author Hiippala, Tuomo
Bateman, John
Wildfeuer, Janina
Author_xml – sequence: 1
  fullname: Bateman, John A.
– sequence: 2
  fullname: Wildfeuer, Janina
– sequence: 3
  fullname: Hiippala, Tuomo
BackLink https://cir.nii.ac.jp/crid/1130000797057959168$$DView record in CiNii
BookMark eNqNkbtvFDEQhx1BEFy4kirNFkgoUg48fqxtOjglIVIQTUS78tpziRPfGuxdovvv4-TyKGhS-DH6fTOWPs_I6yENSMgHoJ9BgvxilOYAVCijjd4hs6eCvyLz51AwvktmjIKiTEhQb8gMKAVeE6XeknkpV7TWGiQX5h05_znFMayTtzGMm-Zrs0rT4O0Y0lAOm4wFbXaXjR18XTZuSigVss2fnPqI60XKAYcRfROGMSc_ubvO92R3ZWPB-cO5R34fH50vfyzOfp2cLr-dLSxXoNUCGQffM8mdBNZ6MKvWrRCYE23bGzSeGu56yQSl2CN6ZgxIbbUA67So3XvkYDvYlmu8KZcpjqX7F7FP6bp0j1I0rWJeyN7bfWZvbBwxe7zI06ZeunW18R_7actWJX8nLGN3P9JVLdnG7uj7UlT1VEEl9x9IzBEvUrd9ugUwRtT04zYdQuhcuNsBeP0rqoyiUhlpoNX8Fn_vlwQ
ContentType eBook
Book
DBID RYH
YSPEL
DEWEY 302.2
DOI 10.1515/9783110479898
DatabaseName CiNii Complete
Perlego
DatabaseTitleList



DeliveryMethod fulltext_linktorsrc
Discipline Languages & Literatures
Anthropology
Social Sciences (General)
EISBN 3110479893
9783110479898
3110480042
9783110480047
Edition 1
ExternalDocumentID 9783110480047
9783110479898
EBC4947071
611994
BB24175291
Genre Electronic books
GroupedDBID 20A
38.
AABBV
AAHDW
AANXU
AAUSU
AAVCP
AAZEP
ABARN
ABAWK
ABHWV
ABQPQ
ABYVA
ACBCG
ACBYE
ACISH
ACLGV
ADDXO
ADOUC
ADVEM
ADZGP
AEAED
AEDVL
AEHGP
AEQHI
AERYV
AETUO
AEZXO
AFHFQ
AGLJD
AGWCO
AHWGJ
AIADE
AIBWD
AIUUY
AJFER
ALMA_UNASSIGNED_HOLDINGS
APFVE
ARPAB
AZVGL
AZZ
BBABE
BECJT
BJCSJ
BKFOJ
DLQEV
EKLKH
MYL
OHILO
PQQKQ
QD8
RYH
YSPEL
AMYDA
I4C
ID FETCH-LOGICAL-a37187-e231db253c5126d19f6cfe12c466b9e9d093cb52400ebeed299158a841ac84e23
ISBN 9783110479423
3110479427
3110480042
9783110480047
IngestDate Wed Jun 04 05:48:39 EDT 2025
Fri Nov 08 05:12:47 EST 2024
Thu Aug 14 17:47:45 EDT 2025
Wed Aug 27 05:50:04 EDT 2025
Tue Jul 01 19:22:37 EDT 2025
Thu Jun 26 23:05:48 EDT 2025
IsPeerReviewed false
IsScholarly false
Keywords Media
Applied Linguistics
Multimodality
Communication
LCCN 2017024517
LCCallNum_Ident P99.4.M6.B24 2017
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-a37187-e231db253c5126d19f6cfe12c466b9e9d093cb52400ebeed299158a841ac84e23
Notes Includes bibliographical references (p. [383]-410) and index
OCLC 1001379477
984637967
PQID EBC4947071
PageCount 1 online resource (424 pages)
ParticipantIDs askewsholts_vlebooks_9783110480047
askewsholts_vlebooks_9783110479898
walterdegruyter_marc_9783110479898
proquest_ebookcentral_EBC4947071
perlego_books_611994
nii_cinii_1130000797057959168
PublicationCentury 2000
PublicationDate c2017
2017
[2017]
2017-04-10
PublicationDateYYYYMMDD 2017-01-01
2017-04-10
PublicationDate_xml – year: 2017
  text: 2017
PublicationDecade 2010
PublicationPlace Berlin
PublicationPlace_xml – name: Berlin
– name: Basel/Berlin/Boston
– name: Boston
PublicationSeriesTitle Mouton Textbook
PublicationYear 2017
Publisher De Gruyter Mouton
De Gruyter
De Gruyter, Inc
Publisher_xml – name: De Gruyter Mouton
– name: De Gruyter
– name: De Gruyter, Inc
RestrictionsOnAccess restricted access
SSID ssj0001815349
ssj0003401800
ssib036176396
ssib026505163
Score 2.6430216
Snippet This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in...
SourceID askewsholts
walterdegruyter
proquest
perlego
nii
SourceType Aggregation Database
Publisher
SubjectTerms Angewandte Sprachwissenschaft
Applied Linguistics
Communication
Communication -- Psychological aspects
Kommunikation
LANGUAGE ARTS & DISCIPLINES
LANGUAGE ARTS & DISCIPLINES / Linguistics / General
Media
Medien
Modality (Linguistics)
Multimodality
Multimodalität
TableOfContents 15 Webpages and dynamic visualisations -- 15.1 Challenges and difficulties: determining objects of analysis -- 15.2 Example analysis: dynamic data visualisations -- 15.3 Summary -- 16 Social media -- 16.1 Previous studies -- 16.2 Communicative situations in social media -- 16.3 Social media analyses and possible methods: Instagram -- 16.4 Summary -- 17 Computer and video games -- 17.1 Example analysis: turn-based strategy games -- 17.2 Example analysis: first-person, real-time games -- 17.3 Summary -- 18 Final words -- 18.1 Lessons learned: the take-home messages -- 18.2 Our goals in the book -- 18.3 Be a multimodalist: have fun and explore! -- Bibliography -- Index
Intro -- Contents -- How to use this book -- Part I: Working your way into 'multimodality' -- 1 Introduction: the challenge of multimodality -- 1.1 First steps ... a multimodal turn? -- 1.2 The journey ahead -- 1.3 What this chapter was about: the 'take-home message' -- 2 Recognising multimodality: origins and inspirations -- 2.1 The 'problem space' of multimodality as such -- 2.2 Materiality and the senses: sound -- 2.3 Materiality and the senses: vision and visuality -- 2.4 Language -- 2.5 Systems that signify: semiotics -- 2.6 Society, culture and media -- 2.7 What this chapter was about: the 'take-home message' -- 3 Where is multimodality? Communicative situations and their media -- 3.1 Stepping beyond the terminological jungle -- 3.2 Communicative situations -- 3.3 Medium (and media) -- 3.4 What this chapter was about: the 'take-home message' -- 4 What is multimodality? Semiotic modes and a new 'textuality' -- 4.1 Semiotic mode -- 4.2 Modes and media -- 4.3 Genre, text, discourse and multimodality -- 4.4 What this chapter was about: the 'take-home message' -- Part II: Methods and analysis -- 5 The scope and diversity of empirical research methods for multimodality -- 5.1 What are methods? What methods are there? -- 5.2 Getting data? -- 5.3 Corpus-based methods to multimodality -- 5.4 Eye-tracking methods for multimodality -- 5.5 Computational methods in multimodality research -- 5.6 Summary and conclusions: selecting tools for the job -- 5.7 A word on good scientific practice: quoting multimodal artefacts -- 6 Are your results saying anything? Some basics -- 6.1 Why statistics?-and how does it work? -- 6.2 What is normal? -- 6.3 Assessing differences -- 6.4 Assessing similarities -- 6.5 How much is enough? -- 6.6 Refinements and restrictions -- 6.7 Inter-coder consistency and reliability -- 6.8 What affects what? Looking for dependencies
6.9 Summary: many types of tests and possibilities -- 7 Multimodal navigator: how to plan your multimodal research -- 7.1 Starting analysis -- 7.2 Undertaking multimodal investigations of phenomena -- 7.3 The basic steps in multimodal analysis reviewed -- 7.4 Conclusions and lessons for effective multimodal research -- Part III: Use cases -- Use case area 1: temporal, unscripted -- 8 Gesture and face-to-face interaction -- 8.1 Previous studies -- 8.2 Describing gesture and its functions -- 8.3 Conclusions -- Use case area 2: temporal, scripted -- 9 Performances and the performing arts -- 9.1 Performance and scripted behaviour -- 9.2 Previous studies -- 9.3 Example analysis: theatre and its canvases -- 9.4 Example analysis: Berlin Philharmonic concerts 'live' -- 9.5 Conclusions -- Use case area 3: spatial, static -- 10 Layout space -- 10.1 Perspectives from graphic design -- 10.2 Example analysis: school textbooks -- 10.3 Example analysis: posters -- 10.4 Summary -- 11 Diagrams and infographics -- 11.1 Aspects of the diagrammatic mode -- 11.2 Example analysis: assembly instructions -- 11.3 Example analysis: information graphics -- 11.4 Summary -- 12 Comics and graphic novels -- 12.1 Comics: basic ingredients -- 12.2 An aside on the notion of 'narrative' -- 12.3 Beyond narrative: comics as non-fiction and metacomics -- 12.4 Issues of literacy -- 12.5 Moving onwards: empirical multimodal comics research -- 12.6 Summary -- Use case area 4: spatial, dynamic -- 13 Film and the moving (audio-)visual image -- 13.1 The technical details of the virtual canvas of film -- 13.2 Multimodal film analysis: an example -- 13.3 Films and comics: adaptation and convergence -- 13.4 Summary -- 14 Audiovisual presentations -- 14.1 Characterising the medium -- 14.2 Exploring the canvases -- 14.3 Summary -- Use case area 5: spatiotemporal, interactive
Contents --
18 Final words: ready, steady, analyse! --
16 Social media --
10 Layout space --
Index
Part I: Working your way into ‘multimodality’ --
4 What is multimodality? Semiotic modes and a new ‘textuality’ --
13 Film and the moving (audio-)visual image --
12 Comics and graphic novels --
15 Webpages and dynamic visualisations --
7 Multimodal navigator: how to plan your multimodal research --
Use case area 4: spatial, dynamic --
How to use this book --
9 Performances and the performing arts --
Use case area 5: spatiotemporal, interactive: ‘media that bite back’ --
1 Introduction: the challenge of multimodality --
Bibliography --
17 Computer and video games --
14 Audiovisual presentations --
6 Are your results saying anything? Some basics --
Use case area 1: temporal, unscripted --
Part II: Methods and analysis --
8 Gesture and face-to-face interaction --
5 The scope and diversity of empirical research methods for multimodality --
Use case area 3: spatial, static --
Use case area 2: temporal, scripted --
3 Where is multimodality? Communicative situations and their media --
Part III: Use cases --
Frontmatter --
2 Recognising multimodality: origins and inspirations --
11 Diagrams and infographics --
Title Multimodality : foundations, research and analysis : a problem-oriented introduction
URI https://cir.nii.ac.jp/crid/1130000797057959168
https://www.perlego.com/book/611994/multimodality-foundations-research-and-analysis-a-problemoriented-introduction-pdf
https://ebookcentral.proquest.com/lib/[SITE_ID]/detail.action?docID=4947071
https://www.degruyter.com/isbn/9783110479898
https://www.vlebooks.com/vleweb/product/openreader?id=none&isbn=9783110479898&uid=none
https://www.vlebooks.com/vleweb/product/openreader?id=none&isbn=9783110480047
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3Pb9MwFLagXNgBAeNHgSELIU5k1Iljx9zoKJqmlVNBu0VOYm8RXVI1CQj-ep5jp0kD0gQXq40cvyRfbH9-8fseQq-DNBSMJNpjXEYeVVx6Qkbak4FmGuZTNgtM7PDyMzv9Qs8uwos-T2gbXVInx-mvv8aV_A-qcAxwNVGy_4DsrlE4AL8BXygBYShH5Hf31-VeMtsAr8vMkmizqte79EgtME7D58ppsTrhERvZ7HLIeKWRODaEMze71TMrIzv0bDrnaLu55sPxwEOTadVYqM9k4fJvW_91vtnIdctHV015XQ59CoSPfAof4QXdNj-NSuOybGpnu1t0BoS0uvQ2TviPIThs1Sr6epHNMj1StZ7PgTrw0DfCA7c5h_HoDszDi2XvH4tgLKbChON09rgVTOrtO81UsPhuz94BOpDVN5gkYAKpK2ANRZ7D-majtmt1We6tJe79aHclZOrS3vCAXKzuo4kJOHmAbqniIXpy7hzIFX6Dz3ea19UhWu2Bjt_jAeRvcQc4BsBxBzhUkngMNx7C_Qh9_bRYnZx6LicG9B6gEdxTQMizxA-hkxGfZURolmpF_JQylgglspkI0iQ0W4Ohf6oM6AYJIxlRItOIwtmP0aQoC_UU4RnVYeprLnxJKIz8UmRMUxnIVKUJzeQUvRo8xvj7uv1-X8V7z_qmSpHRI52iI4AgTnNTEvMFFaip4CYQOoT1CTRy6MCJ7dmMGM3qKcIdUnHbrNuwHC_mJ1TAJXMC5kcIxkYDZv8an91g_jm62_eCF2hSbxt1BFyzTl661_I3_CJ2Lw
linkProvider ProQuest Ebooks
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.title=Multimodality+%3A+foundations%2C+research+and+analysis+%3A+a+problem-oriented+introduction&rft.au=Bateman%2C+John+A.&rft.au=Wildfeuer%2C+Janina&rft.au=Hiippala%2C+Tuomo&rft.date=2017-01-01&rft.pub=De+Gruyter+Mouton&rft.isbn=9783110479423&rft_id=info:doi/10.1515%2F9783110479898&rft.externalDocID=BB24175291
thumbnail_l http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Fwww.perlego.com%2Fbooks%2FRM_Books%2Fde_gruyter_frmluoo%2F9783110480047.jpg
thumbnail_m http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Fwww.degruyter.com%2Fdocument%2Fcover%2Fisbn%2F9783110479898%2Foriginal
http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Fvle.dmmserver.com%2Fmedia%2F640%2F97831104%2F9783110479898.jpg
http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Fvle.dmmserver.com%2Fmedia%2F640%2F97831104%2F9783110480047.jpg