Frontiers in Robotics and AI (Dec 2023)
Working with troubles and failures in conversation between humans and robots: workshop report
- Frank Förster,
- Marta Romeo,
- Marta Romeo,
- Patrick Holthaus,
- Luke J. Wood,
- Christian Dondrup,
- Joel E. Fischer,
- Farhana Ferdousi Liza,
- Sara Kaszuba,
- Julian Hough,
- Birthe Nesset,
- Daniel Hernández García,
- Dimosthenis Kontogiorgos,
- Dimosthenis Kontogiorgos,
- Jennifer Williams,
- Elif Ecem Özkan,
- Pepita Barnard,
- Gustavo Berumen,
- Dominic Price,
- Sue Cobb,
- Martina Wiltschko,
- Lucien Tisserand,
- Martin Porcheron,
- Martin Porcheron,
- Manuel Giuliani,
- Gabriel Skantze,
- Patrick G. T. Healey,
- Ioannis Papaioannou,
- Dimitra Gkatzia,
- Saul Albert,
- Guanyu Huang,
- Vladislav Maraev,
- Epaminondas Kapetanios
Affiliations
- Frank Förster
- Department of Computer Science, School of Physics, Engineering and Computer Science, University of Hertfordshire, Hatfield, United Kingdom
- Marta Romeo
- Department of Computer Science, The University of Manchester, Manchester, United Kingdom
- Marta Romeo
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, United Kingdom
- Patrick Holthaus
- Department of Computer Science, School of Physics, Engineering and Computer Science, University of Hertfordshire, Hatfield, United Kingdom
- Luke J. Wood
- Department of Computer Science, School of Physics, Engineering and Computer Science, University of Hertfordshire, Hatfield, United Kingdom
- Christian Dondrup
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, United Kingdom
- Joel E. Fischer
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Farhana Ferdousi Liza
- School of Computing Sciences, University of East Anglia, Norwich, United Kingdom
- Sara Kaszuba
- Department of Computer, Control and Management Engineering “Antonio Ruberti”, Sapienza University of Rome, Rome, Italy
- Julian Hough
- School of Mathematics and Computer Science, Swansea University, Swansea, United Kingdom
- Birthe Nesset
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, United Kingdom
- Daniel Hernández García
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, United Kingdom
- Dimosthenis Kontogiorgos
- Department of Computer Science, Humboldt University of Berlin, Berlin, Germany
- Dimosthenis Kontogiorgos
- Science of Intelligence, Research Cluster of Excellence, Berlin, Germany
- Jennifer Williams
- 0School of Electronics and Computer Science, University of Southampton, Southampton, United Kingdom
- Elif Ecem Özkan
- 1School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
- Pepita Barnard
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Gustavo Berumen
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Dominic Price
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Sue Cobb
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Martina Wiltschko
- 2Institució Catalana de Recerca i Estudis Avançats, Universitat Pompeu Fabra, Barclona, Spain
- Lucien Tisserand
- 3UMR 5191 ICAR, Centre National de la Recherche Scientifique, Labex ASLAN, ENS de Lyon, Lyon, France
- Martin Porcheron
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
- Martin Porcheron
- 4Computational Foundry, Faculty of Science and Engineering, Swansea University, Swansea, United Kingdom
- Manuel Giuliani
- 5Department of Engineering, Design and Mathematics, University of the West of England, Bristol, United Kingdom
- Gabriel Skantze
- 6Department of Speech Music and Hearing, KTH, Stockholm, Sweden
- Patrick G. T. Healey
- 1School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom
- Ioannis Papaioannou
- 7Alana AI, London, United Kingdom
- Dimitra Gkatzia
- 8School of Computing, Engineering and the Built Environment, Edinburgh Napier University, Edinburgh, United Kingdom
- Saul Albert
- 9School of Social Sciences and Humanities, Loughborough University, Loughborough, United Kingdom
- Guanyu Huang
- 0Department of Computer Science, The University of Sheffield, Sheffield, United Kingdom
- Vladislav Maraev
- 1Department of Applied IT, Univeristy of Gothenburg, Göteborg, Sweden
- Epaminondas Kapetanios
- Department of Computer Science, School of Physics, Engineering and Computer Science, University of Hertfordshire, Hatfield, United Kingdom
- DOI
- https://doi.org/10.3389/frobt.2023.1202306
- Journal volume & issue
-
Vol. 10
Abstract
This paper summarizes the structure and findings from the first Workshop on Troubles and Failures in Conversations between Humans and Robots. The workshop was organized to bring together a small, interdisciplinary group of researchers working on miscommunication from two complementary perspectives. One group of technology-oriented researchers was made up of roboticists, Human-Robot Interaction (HRI) researchers and dialogue system experts. The second group involved experts from conversation analysis, cognitive science, and linguistics. Uniting both groups of researchers is the belief that communication failures between humans and machines need to be taken seriously and that a systematic analysis of such failures may open fruitful avenues in research beyond current practices to improve such systems, including both speech-centric and multimodal interfaces. This workshop represents a starting point for this endeavour. The aim of the workshop was threefold: Firstly, to establish an interdisciplinary network of researchers that share a common interest in investigating communicative failures with a particular view towards robotic speech interfaces; secondly, to gain a partial overview of the “failure landscape” as experienced by roboticists and HRI researchers; and thirdly, to determine the potential for creating a robotic benchmark scenario for testing future speech interfaces with respect to the identified failures. The present article summarizes both the “failure landscape” surveyed during the workshop as well as the outcomes of the attempt to define a benchmark scenario.
Keywords
- human-robot interaction
- speech interfaces
- dialogue systems
- multi-modal interaction
- communicative failure
- repair