Till sidans topp

Sidansvarig: Webbredaktion
Sidan uppdaterades: 2012-09-11 15:12

Tipsa en vän
Utskriftsversion

Contributions of differen… - Göteborgs universitet Till startsida
Webbkarta
Till innehåll Läs mer om hur kakor används på gu.se

Contributions of different modalities to the attribution of affective-epistemic states

Paper i proceeding
Författare Jens Allwood
Stefano Lanzini
Elisabeth Ahlsén
Publicerad i Proceedings from the 1st European Symposium on Multimodal Communication, University of Malta, Valletta, October 17-18, 2013, NEALT Proceedings Series, Linköping Electronic Conference Proceedings
Nummer/häfte 101
Sidor 1-6
ISBN 978-91-7519-266-6
ISSN 1650-3686
Publiceringsår 2014
Publicerad vid Kollegium SSKKII (2010-)
Institutionen för tillämpad informationsteknologi (GU)
Sidor 1-6
Språk en
Länkar www.ep.liu.se/ecp/101/001/ecp131010...
Ämneskategorier Språk och litteratur

Sammanfattning

The focus of this study is the relation between multimodal and unimodal perception of emo-tions and attitudes. A point of departure for the study is the claim that multimodal presentation increases redundancy and often thereby also the correctness of interpretation. A study was carried out in order to investigate this claim by examining the relative role of unimodal versus multimodal visual and auditory perception for interpreting affective-epistemic states (AES). The abbreviation AES will be used both for the singular form “affective-epistemic state” and the plural form “affective-epistemic states”. Clips from video-recorded dyadic in-teractions were presented to 12 subjects using three types of presentation, Audio only, Video only and Audio+Video. The task was to inter-pret the affective-epistemic states of one of the two persons in the clip. The results indicated differences concerning the role of different sensory modalities for different affective-epistemic states. In some cases there was a “filtering” effect, rendering fewer interpreta-tions in a multimodal presentation than in a unimodal one for a specific AES. This oc-curred for happiness, disinterest and under-standing, whereas “mutual reinforcement”, rendering more interpretations for multimodal presentation than for unimodal video or audio presentation, occurred for nervousness, inter-est and thoughtfulness. Finally, for one AES, confidence, audio and video seem to have mu-tually restrictive roles.

Sidansvarig: Webbredaktion|Sidan uppdaterades: 2012-09-11
Dela:

På Göteborgs universitet använder vi kakor (cookies) för att webbplatsen ska fungera på ett bra sätt för dig. Genom att surfa vidare godkänner du att vi använder kakor.  Vad är kakor?