UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

An ‘Ethical Black Box’, Learning From Disagreement in Shared Control Systems

Eberle, H; Zhang, B; Teodorescu, C; Walker, G; Carlson, T; (2021) An ‘Ethical Black Box’, Learning From Disagreement in Shared Control Systems. In: (Proceedings) IEEE International Conference On Systems, Man, and Cybernetics (SMC). IEEE (In press). Green open access

[thumbnail of SMC21_0502_MS.pdf]
Preview
Text
SMC21_0502_MS.pdf - Accepted Version

Download (884kB) | Preview

Abstract

Shared control, where a human user cooperates with an algorithm to operate a device, has the potential to greatly expand access to powered mobility, but also raises unique ethical challenges. A shared-control wheelchair may perform actions that do not reflect its user’s intent in order to protect their safety, causing frustration or distrust in the process. Unlike physical accidents there is currently no framework for investigating or adjudicating these events, leading to a reduced capability to improve the shared control algorithm’s user experience. In this paper we suggest a system based on the idea of an ‘ethical black box’ that records the sensor context of sub-critical disagreements and collision risks in order to allow human investigators to examine them in retrospect and assess whether the algorithm has taken control from the user without justification.

Type: Proceedings paper
Title: An ‘Ethical Black Box’, Learning From Disagreement in Shared Control Systems
Event: IEEE International Conference On Systems, Man, and Cybernetics (SMC)
Location: Melbourne, Australia (Virtual Online)
Dates: 17 October 2021 - 20 October 2021
Open access status: An open access version is available from UCL Discovery
Publisher version: https://ieeexplore.ieee.org/Xplore/home.jsp
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Shared control, Powered wheelchair, Assistive technology, Safety
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > Div of Surgery and Interventional Sci > Department of Ortho and MSK Science
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Chemical Engineering
URI: https://discovery.ucl.ac.uk/id/eprint/10132709
Downloads since deposit
195Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item