Title
What Do You Want From Me? Adapting Systems to the Uncertainty of Human Preferences
Date Issued
01 January 2022
Access level
open access
Resource Type
conference paper
Author(s)
Bennaceur A.
Kordoni A.
Levine M.
Nuseibeh B.
The Open University
Publisher(s)
IEEE Computer Society
Abstract
Autonomous systems, like drones and self-driving cars, are becoming part of our daily lives. Multiple people interact with them, each with their own expectations regarding system behaviour. To adapt system behaviour to human preferences, we propose and explore a game-theoretic approach. In our architecture, autonomous systems use sensor data to build game-theoretic models of their interaction with humans. In these models, we represent human preferences with types and a probability distribution over them. Game-theoretic analysis then outputs a strategy, that determines how the system should act to maximise utility, given its beliefs over human types. We showcase our approach in a search-and-rescue (SAR) scenario, with a robot in charge of locating victims. According to social psychology, depending on their identity some people are keen to help others, while some prioritise their personal safety. These social identities define what a person favours, so we can map them directly to game-theoretic types. We show that our approach enables a SAR robot to take advantage of human collaboration, outperforming non-adaptive configurations in average number of successful evacuations.
Start page
126
End page
130
Language
English
OCDE Knowledge area
Ingeniería química
Scopus EID
2-s2.0-85132999366
Source
Proceedings - International Conference on Software Engineering
Resource of which it is part
Proceedings - International Conference on Software Engineering
ISSN of the container
02705257
ISBN of the container
9781665495967
Conference
44th ACM/IEEE International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-NIER 2022
Sponsor(s)
This work was supported by the Engineering and Physical Sciences Research Council [grant numbers EP/V026747/1, EP/R013144/1]; and Science Foundation Ireland [grant number 13/RC/2094_P2].
Sources of information: Directorio de Producción Científica Scopus