Access the full text.
Sign up today, get DeepDyve free for 14 days.
H. Knublauch, R. Fergerson, Natasha Noy, M. Musen (2004)
The Protégé OWL Plugin: An Open Development Environment for Semantic Web Applications
Geert-Jan M. Kruijff, Hendrik Zender, Patric Jensfelt, Henrik I. Christensen (2007)
Situated dialogue and spatial organization: What, where…and why? International Journal of Advanced Robotic Systems 4, 1 (2007), 125--138Situated dialogue and spatial organization: What
Séverin Lemaignan, Raquel Ros, Lorenz Mösenlechner, R. Alami, M. Beetz (2010)
ORO, a knowledge management platform for cognitive architectures in robotics2010 IEEE/RSJ International Conference on Intelligent Robots and Systems
Robin Deits, Stefanie Tellex, Pratiksha Thaker, D. Simeonov, T. Kollar, N. Roy (2013)
Clarifying commands with information-theoretic human-robot dialogJournal of Human-Robot Interaction, 2
Stefanie Tellex, T. Kollar, Steven Dickerson, Matthew Walter, A. Banerjee, S. Teller, N. Roy (2011)
Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation
Gabriel Skantze (2005)
Exploring human error recovery strategies: Implications for spoken dialogue systemsSpeech Commun., 45
M. Schober (2009)
Spatial Dialogue between Partners with Mismatched Abilities
Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun (2015)
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 39
Jayant Krishnamurthy, T. Kollar (2013)
Jointly Learning to Parse and Perceive: Connecting Natural Language to the Physical WorldTransactions of the Association for Computational Linguistics, 1
T. Tenbrink, R. Ross, K. Thomas, Nina Dethlefs, E. Andonova (2010)
Route instructions in map-based human-human and human-computer dialogue: A comparative analysisJ. Vis. Lang. Comput., 21
Theodora Koulouri, S. Lauria (2009)
A corpus-based analysis of route instructions in human-robot interaction
J. Hough, David Schlangen (2016)
Investigating Fluidity for Human-Robot Interaction with Real-time, Real-world Grounding Strategies
Sachithra Hemachandra, Felix Duvallet, T. Howard, N. Roy, A. Stentz, Matthew Walter (2015)
Learning models for following natural language directions in unknown environments2015 IEEE International Conference on Robotics and Automation (ICRA)
M. Walker, S. Whittaker, Amanda Stent, Preetam Maloor, Johanna Moore, Michael Johnston, Gunaranjan Vasireddy (2004)
Generation and evaluation of user tailored responses in multimodal dialogueCogn. Sci., 28
M. Skubic, Dennis Perzanowski, Samuel Blisard, A. Schultz, W. Adams, M. Bugajska, Derek Brock (2004)
Spatial language for human-robot dialogsIEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 34
Stephanie Schuldes, M. Roth, A. Frank, M. Strube (2009)
Creating an Annotated Corpus for Generating Walking Directions
Jack E. Bresenham (1965)
Algorithm for computer control of a digital plotterIBM Systems Journal, 4
Michael Levit, D. Roy (2007)
Interpretation of Spatial Language in a Map Navigation TaskIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 37
T. Kollar, Stefanie Tellex, D. Roy, N. Roy (2010)
Toward understanding natural language directions2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
Eui-Hong Han, G. Karypis, Vipin Kumar (2001)
Text Categorization Using Weight Adjusted k-Nearest Neighbor Classification
Hui Shi, T. Tenbrink (2009)
Telling Rolland Where to Go: HRI Dialogues on Route Navigation
M. Walker, Jeremy Wright, Irene Langkilde (2000)
Using Natural Language Processing and Discourse Features to Identify Understanding Errors in a Spoken Dialogue System
Cynthia Matuszek, E. Herbst, Luke Zettlemoyer, D. Fox (2012)
Learning to Parse Natural Language Commands to a Robot Control System
M. Marge, Alexander Rudnicky (2011)
The TeamTalk Corpus: Route Instructions in Open Spaces
M. Marge, Aasish Pappu, Benjamin Frisch, T. Harris, Alexander Rudnicky (2009)
Exploring Spoken Dialog Interaction in Human-Robot Teams
Marius Muja, D. Lowe (2014)
Scalable Nearest Neighbor Algorithms for High Dimensional DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 36
Vasumathi Raman, Constantine Lignos, Cameron Finucane, Kenton Lee, Mitchell Marcus, H. Kress-Gazit (2013)
Sorry Dave, I'm Afraid I Can't Do That: Explaining Unachievable Robot Tasks Using Natural Language, 09
A. Anderson, M. Bader, E. Bard, E. Boyle, Gwyneth Doherty, S. Garrod, S. Isard, Jacqueline Kowtko, J. McAllister, Jim Miller, Catherine Sotillo, H. Thompson, R. Weinert (1991)
The Hcrc Map Task CorpusLanguage and Speech, 34
Stephanie Rosenthal, Joydeep Biswas, M. Veloso (2010)
An effective personal mobile robot agent through symbiotic human-robot interaction
N. Shimizu, A. Haas (2009)
Learning to Follow Navigational Route Instructions
Genevieve Gorrell, Ian Lewin, Manny Rayner (2002)
Adding intelligent help to mixed-initiative spoken dialogue systems
Vittorio Perera, M. Veloso (2015)
Handling Complex Commands as Service Robot Task Requests
B. Fransen, Vlad Morariu, E. Martinson, Samuel Blisard, M. Marge, Scott Thomas, A. Schultz, Dennis Perzanowski (2007)
Using vision, acoustics, and natural language for disambiguation2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI)
M. Marge, Aaron Powers, Jonathan Brookshire, Trevor Jay, O. Jenkins, Christopher Geyer (2011)
Comparing Heads-up, Hands-free Operation of Ground Robots to Teleoperation, 07
Yoav Artzi, Luke Zettlemoyer (2013)
Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to ActionsTransactions of the Association for Computational Linguistics, 1
David Chen, R. Mooney (2011)
Learning to Interpret Natural Language Navigation Instructions from Observations
Stefano Carpin, M. Lewis, Jijun Wang, S. Balakirsky, C. Scrapper (2007)
USARSim: a robot simulator for research and educationProceedings 2007 IEEE International Conference on Robotics and Automation
S. Balakirsky, Christopher Scrapper, Elena Messina (2005)
Mobility open architecture simulation and tools environmentInternational Conference on Integration of Knowledge Intensive Multi-Agent Systems, 2005.
Antoine Raux, M. Eskénazi (2008)
Optimizing Endpointing Thresholds using Dialogue Features in a Spoken Dialogue System
D. Bohus, C. Saw, E. Horvitz (2014)
Directions robot: in-the-wild experiences and lessons learned
D. Litman, Julia Hirschberg, M. Swerts (2000)
Predicting Automatic Speech Recognition Performance Using Prosodic Cues
Alexander Rudnicky, Roni Rosenfeld, D. Bohus (2007)
Error awareness and recovery in conversational spoken language interfaces
Gabriel Skantze (2007)
Making Grounding Decisions: Data-driven Estimation of Dialogue Costs and Confidence Thresholds
M. Foster, M. Giuliani, Amy Isard, C. Matheson, J. Oberlander, A. Knoll (2009)
Evaluating Description and Reference Strategies in a Cooperative Human-Robot Dialogue System
D. Bohus, Alexander Rudnicky (2009)
The RavenClaw dialog management framework: Architecture and systemsComput. Speech Lang., 23
Yonatan Bisk, Deniz Yuret, D. Marcu (2016)
Natural Language Communication with Robots
Felix Duvallet, Matthew Walter, T. Howard, Sachithra Hemachandra, Jean Oh, S. Teller, N. Roy, A. Stentz (2015)
Inferring Maps and Behaviors from Natural Language Instructions
Laura Stoia, Darla Shockley, D. Byron, E. Fosler-Lussier (2008)
SCARE: a Situated Corpus with Annotated Referring Expressions
David Huggins-Daines, Mohit Kumar, Arthur Chan, A. Black, M. Ravishankar, Alexander Rudnicky (2006)
Pocketsphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, 1
N. Mavridis (2014)
A review of verbal and non-verbal human-robot interactive communicationRobotics Auton. Syst., 63
T. Harris, Alexander Rudnicky (2007)
TeamTalk: A Platform for Multi-Human-Robot Dialog Research in Coherent Real and Virtual Spaces
H. Asoh, N. Vlassis, Y. Motomura, F. Asano, Isao Hara, S. Hayamizu, K. Itou, Takio Kurita, T. Matsui, R. Bunschoten, B. Kröse (2001)
Jijo-2: An Office Robot that Communicates and LearnsIEEE Intell. Syst., 16
G. Bugmann, Ewan Klein, S. Lauria, T. Kyriacou (2003)
Corpus-Based Robotics: A Route Instruction Example
Abdeslam Boularias, Felix Duvallet, Jean Oh, A. Stentz (2016)
Learning Qualitative Spatial Relations for Robotic Navigation
T. Fong, C. Thorpe, C. Baur (2001)
Collaboration, Dialogue, and Human-Robot Interaction
G. Kruijff, H. Zender, P. Jensfelt, H. Christensen (2007)
Situated Dialogue and Spatial Organization: What, Where… and Why?International Journal of Advanced Robotic Systems, 4
Patrick Lester (2005)
A* Pathfinding for Beginnershttps://www.gamedev.net/articles/programming/artificial-intelligence/a-pathfinding-for-beginners-r2003/.
T. Williams, Fereshta Yazdani, P. Suresh, Matthias Scheutz, M. Beetz (2018)
Dempster-Shafer theoretic resolution of referential ambiguityAutonomous Robots, 43
(1997)
Machine Learning
S. Cox, R. Rose (1996)
Confidence measures for the SWITCHBOARD database1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, 1
Aasish Pappu, Alexander Rudnicky (2012)
The Structure and Generality of Spoken Route Instructions
Iulian Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, Joelle Pineau (2015)
A Survey of Available Corpora for Building Data-Driven Dialogue SystemsArXiv, abs/1512.05742
Dhananjay Bansal, M. Ravishankar (1998)
New features for confidence annotation5th International Conference on Spoken Language Processing (ICSLP 1998)
Adam Vogel, Dan Jurafsky (2010)
Learning to Follow Navigational Directions
(1994)
Experiencing real-life interactions with the experimental platform of MAIA
Teresa Zollo (1999)
A Study of Human Dialogue Strategies the Presence of Speech Recognition Errors
L. Chase (1997)
Error-responsive feedback mechanisms for speech recognizers
Antoine Raux, Maxine Eskenazi (2004)
Non-native users in the Let’s Go!! Spoken dialogue system: Dealing with linguistic mismatchProceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL’04).
R. Meena, José Lopes, Gabriel Skantze, Joakim Gustafson (2015)
Automatic Detection of Miscommunication in Spoken Dialogue Systems
D. Bohus, Alexander Rudnicky (2002)
Integrating Multiple Knowledge Sources for Utterance-Level Confidence Annotation in the CMU Communicator Spoken Dialog System
Alexander Rudnicky, Aasish Pappu, Peng Li, M. Marge, Benjamin Frisch (2010)
Instruction Taking in the TeamTalk System
S. Balakirsky, Stefano Carpin, Michael Lewis (2009)
Robots, games, and research: success stories in USARSim
Dennis Perzanowski, Derek Brock, W. Adams, M. Bugajska, A. Schultz, J. Trafton, Samuel Blisard, M. Skubic (2003)
Finding the FOO: a pilot study for a multimodal interfaceSMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483), 4
T. Fong, C. Thorpe, C. Baur (2001)
Collaboration, Dialogue, Human-Robot Interaction
D. Bohus, Antoine Raux, T. Harris, M. Eskénazi, Alexander Rudnicky (2007)
Olympus: an open-source framework for conversational spoken language interface research
Cynthia Matuszek, D. Fox, Karl Koscher (2010)
Following directions using statistical machine translation2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
D. Bohus, E. Horvitz (2010)
On the Challenges and Opportunities of Physically Situated Dialog
David Schlangen (2004)
Causes and Strategies for Requesting Clarification in Dialogue
Moritz Tenorth, M. Beetz (2013)
KnowRob: A knowledge processing infrastructure for cognition-enabled robotsThe International Journal of Robotics Research, 32
(2005)
Latin Squares in Experimental Design
Ioannis Papaioannou, Oliver Lemon (2017)
Combining Chat and Task-Based Multimodal Dialogue for More Engaging HRI: A Scalable Method Using Reinforcement LearningProceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction
Edward T. Hall (1966)
The Hidden DimensionDoubleday 8 Co., 8
Aishwarya Padmakumar, Jesse Thomason, R. Mooney (2017)
Integrated Learning of Dialog Strategies and Semantic Parsing
M. Marge, Alexander Rudnicky (2011)
Towards Overcoming Miscommunication in Situated Dialogue by Asking Questions
Juraj Dzifcak, Matthias Scheutz, Chitta Baral, P. Schermerhorn (2009)
What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution2009 IEEE International Conference on Robotics and Automation
Antoine Raux, M. Eskénazi (2004)
Non-Native Users in the Let’s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch
H. Clark, S. Brennan (1991)
Grounding in communication
Hui Shi, B. Krieg-Brückner (2008)
Modelling Route Instructions for Robust Human-Robot Interaction on Navigation TasksInt. J. Softw. Informatics, 2
E. Bastianelli, Giuseppe Castellucci, D. Croce, Roberto Basili, D. Nardi (2017)
Structured learning for spoken language understanding in human-robot interactionThe International Journal of Robotics Research, 36
M. Walker, Jeremy Wright, Irene Langkilde-Geary (2000)
Using Natural Language Processing and discourse Features to Identify Understanding Errors
(2007)
Incremental, multilevel processing for comprehending situated dialogue in human-robot interaction
Lorenzo Lucignano, F. Cutugno, Silvia Rossi, Alberto Finzi (2013)
A dialogue system for multimodal human-robot interaction
César Cadena, L. Carlone, Henry Carrillo, Y. Latif, D. Scaramuzza, José Neira, I. Reid, J. Leonard (2016)
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception AgeIEEE Transactions on Robotics, 32
S. Lauria, G. Bugmann, T. Kyriacou, Johan Bos, Ewan Klein (2002)
Converting natural language route instructions into robot executable proceduresProceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication
D. Harville (1977)
Maximum Likelihood Approaches to Variance Component Estimation and to Related ProblemsJournal of the American Statistical Association, 72
Gabriel Skantze (2007)
Error Handling in Spoken Dialogue Systems : Managing Uncertainty, Grounding and Miscommunication
Herbert H. Clark (1996)
Using LanguageCambridge University Press
David Huggins-Daines, Mohit Kumar, Arthur Chan, Alan W. Black, Mosur Ravishankar, Alexander I. Rudnicky (2006)
PocketSphinx: A free, real-time continuous speech recognition system for hand-held devicesProceedings of the IEEE International Conference on Acoustics
G. Kruijff, Pierre Lison, T. Benjamin, H. Jacobsson, H. Zender, Ivana Kruijff-Korbayová, Nick Hawes (2010)
Situated Dialogue Processing for Human-Robot Interaction
Tim Paek (2003)
Toward a Taxonomy of Communication Errors
E. Krahmer, M. Swerts, M. Theune, M. Weegels (2001)
Error Detection in Spoken Human-Machine InteractionInternational Journal of Speech Technology, 4
G. Bouwman, J. Sturm, L. Boves (1999)
Incorporating confidence measures in the Dutch train timetable information system developed in the ARISE project1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258), 1
S. Harnad (1990)
Symbol grounding problemScholarpedia, 2
(2015)
Miscommunication Detection and Recovery for Spoken Dialogue Systems in Physically Situated Contexts
C. Grant (1956)
On Using LanguageThe Philosophical Quarterly, 6
Andrea Vanzo, D. Croce, E. Bastianelli, Guglielmo Gemignani, Roberto Basili, D. Nardi (2016)
Dialogue with Robots to Support Symbiotic Autonomy
Hongyuan Mei, Mohit Bansal, Matthew Walter (2015)
Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action SequencesArXiv, abs/1506.04089
J. Bresenham (1965)
Algorithm for computer control of a digital plotterSeminal graphics: pioneering efforts that shaped the field
M. MacMahon, B. Stankiewicz, B. Kuipers (2006)
Walk the Talk: Connecting Language, Knowledge, and Action in Route Instructions
(1998)
Voice-controlled surgical robot ready to assist in minimally invasive heart surgery
D. Spiliotopoulos, Ion Androutsopoulos, C. Spyropoulos (2001)
HUMAN-ROBOT INTERACTION BASED ON SPOKEN NATURAL LANGUAGE DIALOGUE
M. Foster, R. Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, J. Odobez, A. Pandey (2016)
The MuMMER Project: Engaging Human-Robot Interaction in Real-World Public Spaces
Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, Joelle Pineau (2018)
A survey of available corpora for building data-driven dialogue systems: The journal versionDialogue and Discourse, 9
N. Mavridis, D. Roy (2006)
Grounded Situation Models for Robots: Where words and percepts meet2006 IEEE/RSJ International Conference on Intelligent Robots and Systems
Rubén San-Segundo-Hernández, B. Pellom, Wayne Ward, J. Pardo (2000)
Confidence measures for dialogue management in the CU Communicator system2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100), 2
Alan Lipman, E. Hall (1970)
The Hidden DimensionBritish Journal of Sociology, 21
Stephen Balakirsky, Chris Scrapper, Elena Messina (2005)
Mobility open architecture simulation and tools environmentProceedings of the Knowledge Intensive Multi-Agent Systems Conference (KIMAS’05).
Oliver Lemon, Anne Bracy, A. Gruenstein, S. Peters (2003)
A multi-modal dialogue system for human-robot conversation
(2005)
A* Pathfinding for Beginners. https://www.gamedev.net/articles/programming/artificialintelligence/a-pathfinding-for-beginners-r2003
Dennis Perzanowski, Derek Brock, William Adams, Magdalena Bugajska, Alan C. Schultz, J. Gregory Trafton, Samuel Blisard, Marjorie Skubic (2003)
Finding the FOO: A pilot study for a multimodal interfaceProceedings of the IEEE International Conference on Systems
M. Walker, D. Litman, C. Kamm, A. Abella (1998)
Evaluating spoken dialogue agents with PARADISE: Two case studiesComput. Speech Lang., 12
Samuel Bayer, Christine Doran, Bryan George (2001)
Exploring Speech-Enabled Dialogue with the Galaxy Communicator Infrastructure
J. MacGlashan, Monica Babes-Vroman, Marie desJardins, M. Littman, S. Muresan, S. Squire, Stefanie Tellex, Dilip Arumugam, Lei Yang (2015)
Grounding English Commands to Reward Functions, 11
Jesse Thomason, Shiqi Zhang, R. Mooney, P. Stone (2015)
Learning to Interpret Natural Language Commands through Human-Robot Dialog
M. Marge, Alexander Rudnicky (2010)
Comparing Spoken Language Route Instructions for Robots across Environment Representations
T. Williams, Matthias Scheutz (2017)
Resolution of Referential Ambiguity in Human-Robot Dialogue Using Dempster-Shafer Theoretic Pragmatics, 13
Matthias Scheutz, R. Cantrell, P. Schermerhorn (2011)
Toward Humanlike Task-Based Dialogue Processing for Human Robot InteractionAI Mag., 32
M. Marge, Alexander Rudnicky (2015)
Miscommunication Recovery in Physically Situated Dialogue
Ross Knepper, Stefanie Tellex, Adrian Li, N. Roy, D. Rus (2015)
Recovering from failure by asking for helpAutonomous Robots, 39
I. Casanueva, Thomas Hain, H. Christensen, R. Marxer, P. Green (2015)
Knowledge transfer between speakers for personalised dialogue management
R. Meena, Gabriel Skantze, Joakim Gustafson (2014)
Data-driven models for timing feedback responses in a Map Task dialogue systemComput. Speech Lang., 28
Juan Fasola, M. Matarić (2013)
Using semantic fields to model dynamic spatial relations in a robot architecture for natural language instruction of service robots2013 IEEE/RSJ International Conference on Intelligent Robots and Systems
Séverin Lemaignan, Raquel Ros, E. Sisbot, R. Alami, M. Beetz (2012)
Grounding the Interaction: Anchoring Situated Discourse in Everyday Human-Robot InteractionInternational Journal of Social Robotics, 4
Alexander Broad, Jacob Arkin, Nathan Ratliff, T. Howard, B. Argall (2017)
Real-time natural language corrections for assistive robotic manipulatorsThe International Journal of Robotics Research, 36
R. Meena, Gabriel Skantze, Joakim Gustafson (2012)
A Data-driven Approach to Understanding Spoken Route Directions in Human-Robot Dialogue
J. Chai, Rui Fang, Changsong Liu, Lanbo She (2017)
Collaborative Language Grounding Toward Situated Human-Robot DialogueAI Mag., 37
Even without speech recognition errors, robots may face difficulties interpreting natural-language instructions. We present a method for robustly handling miscommunication between people and robots in task-oriented spoken dialogue. This capability is implemented in TeamTalk, a conversational interface to robots that supports detection and recovery from the situated grounding problems of referential ambiguity and impossible actions. We introduce a representation that detects these problems and a nearest-neighbor learning algorithm that selects recovery strategies for a virtual robot. When the robot encounters a grounding problem, it looks back on its interaction history to consider how it resolved similar situations. The learning method is trained initially on crowdsourced data but is then supplemented by interactions from a longitudinal user study in which six participants performed navigation tasks with the robot. We compare results collected using a general model to user-specific models and find that user-specific models perform best on measures of dialogue efficiency, while the general model yields the highest agreement with human judges. Our overall contribution is a novel approach to detecting and recovering from miscommunication in dialogue by including situated context, namely, information from a robot’s path planner and surroundings.
ACM Transactions on Interactive Intelligent Systems (TiiS) – Association for Computing Machinery
Published: Feb 17, 2019
Keywords: Human–robot communication
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.