Look on my thesis, ye mighty: gaze interaction and social robotics

Somashekarappa, Vidya
2024-04-02T08:03:53Z
2024-04-02T08:03:53Z
2024-04-02
Gaze, a significant non-verbal social signal, conveys attentional cues and provides insight into others’ intentions and future actions. The thesis examines the intricate aspects of gaze in human-human dyadic interaction, aiming to extract insights applicable to enhance multimodal human-agent dialogue. By annotating various types of gaze behavior alongside speech, the thesis explores the meaning of temporal patterns in gaze cues and their correlations. On the basis of leveraging a multimodal corpus of dyadic taste-testing interactions, the thesis further investigates the relationship between laughter, pragmatic functions, and accompanying gaze patterns. The findings reveal that laughter serves different pragmatic functions in association with distinct gaze patterns, underscoring the importance of laughter and gaze in multimodal meaning construction and coordination, relevant for designing human-like conversational agents. The thesis also proposes a novel approach to estimate gaze using a neural network architecture, considering dynamic patterns of real-world gaze behavior in natural interaction. The framework aims to facilitate responsive and intuitive interaction by enabling robots/avatars to communicate with humans using natural multimodal dialogue. This framework performs unified gaze detection, gaze-object prediction, and object-landmark heatmap generation. Evaluation on annotated datasets demonstrates superior performance compared to previous methods, with promising implications for implementing a contextualized gaze-tracking behavior in robotic interaction. Finally, the thesis investigates the impact of different gaze patterns from a robot on Human-Robot Interaction (HRI). The results suggest that manipulating robot gaze based on human-human interaction patterns positively influences user perceptions, enhancing anthropomorphism and engagement.sv
2024-04-25
Thursday 25th April, 13:15sv
Department of Philosophy, Linguistics and Theory of Science ; Institutionen för filosofi, lingvistik och vetenskapsteorisv
HF
Göteborgs universitet. Humanistiska fakultetenswe
University of Gothenburg. Faculty of Humanitieseng
978-91-8069-659-3 (PRINT)
978-91-8069-660-9 (PDF)
https://hdl.handle.net/2077/80112
engsv
Computational Linguisticssv
Computer Visionsv
Human-Robot Interactionsv
Gaze Interactionsv
Multimodal Dialoguesv
Look on my thesis, ye mighty: gaze interaction and social roboticssv
Text
Doctor of Philosophysv
Doctoral thesiseng

Files

Original bundle

Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
PhD_Thesis (28).pdf
Size:
8.15 MB
Format:
Adobe Portable Document Format
Description:
PhD Thesis
Loading...
Thumbnail Image
Name:
Nailing Sheet.pdf
Size:
178.81 KB
Format:
Adobe Portable Document Format
Description:

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
4.68 KB
Format:
Item-specific license agreed upon to submission
Description: