Large Language Models as Zero-Shot Human Models for Human-Robot Interaction, Bowen Zhang★, Harold Soh★, 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)
Links:
Human models play a crucial role in human-robot interaction (HRI), enabling robots to consider the impact of their actions on people and plan their behavior accordingly. However, crafting good human models is challenging; capturing context-dependent human behavior requires significant prior knowledge and/or large amounts of interaction data, both of which are difficult to obtain.
In this work, we explore the potential of large-language models (LLMs) – which have consumed vast amounts of human-generated text data – to act as zero-shot human models for HRI.
Our experiments on three social datasets yield promising results; the LLMs are able to achieve performance comparable to purpose-built models. That said, we also discuss current limitations, such as sensitivity to prompts and spatial/numerical reasoning mishaps.
Based on our findings, we demonstrate how LLM-based human models can be integrated into a social robot’s planning process and applied in HRI scenarios. Specifically, we present one case study on a simulated trust-based table-clearing task and replicate past results that relied on custom models. Next, we conduct a new robot utensil-passing experiment (n = 65) where preliminary results show that planning with a LLM-based human model can achieve gains over a basic myopic plan.
In summary, our results show that LLMs offer a promising (but incomplete) approach to human modeling for HRI.
Resources
You can find our paper here. Check out our repository here on github
Citation
Please consider citing our paper if you build upon our results and ideas.
Bowen Zhang★, Harold Soh★, “Large Language Models as Zero-Shot Human Models for Human-Robot Interaction”, 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)
@inproceedings{bowen23large,
url = {https://arxiv.org/abs/2303.03548},
author={Zhang, Bowen and Soh, Harold},
title={Large Language Models as Zero-Shot Human Models for Human-Robot Interaction},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2023} }
Contact
If you have questions or comments, please contact Bowen or Harold.
Acknowledgements
This research is supported by the National Research Foundation Singapore and DSO National Laboratories under the AI Singapore Programme (AISG Award No: AISG2-RP- 2020-017).
