Exploring Human attitude during Human-Robot Interaction

A. Sorrentino, L. Fiorini, I. Fabbricotti, D. Sancarlo, F. Ciccone, F. Cavallo

Research output: Chapter/Conference proceedingConference proceedingAcademicpeer-review

2 Citations (Scopus)

Abstract

The aim of this work is to provide an automatic analysis to assess the user attitude when interacts with a companion robot. In detail, our work focuses on defining which combination of social cues the robot should recognize so that to stimulate the ongoing conversation and how. The analysis is performed on video recordings of 9 elderly users. From each video, low-level descriptors of the behavior of the user are extracted by using open-source automatic tools to extract information on the voice, the body posture, and the face landmarks. The assessment of 3 types of attitude (neutral, positive and negative) is performed through 3 machine learning classification algorithms: k-nearest neighbors, random decision forest and support vector regression. Since intra- and intersubject variability could affect the results of the assessment, this work shows the robustness of the classification models in both scenarios. Further analysis is performed on the type of representation used to describe the attitude. A raw and an auto-encoded representation is applied to the descriptors. The results of the attitude assessment show high values of accuracy (>0.85) both for unimodal and multimodal data. The outcome of this work can be integrated into a robotic platform to automatically assess the quality of interaction and to modify its behavior accordingly.

Original languageEnglish
Title of host publication29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages195-200
Number of pages6
ISBN (Electronic)9781728160757
DOIs
Publication statusPublished - 14 Oct 2020
Event29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020 - Virtual, Naples, Italy
Duration: 31 Aug 20204 Sept 2020

Publication series

Series29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020

Conference

Conference29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020
Country/TerritoryItaly
CityVirtual, Naples
Period31/08/204/09/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Fingerprint

Dive into the research topics of 'Exploring Human attitude during Human-Robot Interaction'. Together they form a unique fingerprint.

Cite this