UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms

Koshiyama, Adriano; Kazim, Emre; Treleaven, Philip; Rai, Pete; Szpruch, Lukasz; Pavey, Giles; Ahamat, Ghazi; ... Chatterjee, Siddhant; + view all (2024) Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms. Royal Society Open Science , 11 , Article 230859. 10.1098/rsos.230859. Green open access

[thumbnail of Towards algorithm auditing managing legal, ethical and technological risks of AI, ML and associated algorithms - koshiyama-et-al-2024-towards-algorithm-auditing-managing-legal-ethical-and-technological-risks-of-ai-ml-and-associated.pdf]
Preview
PDF
Towards algorithm auditing managing legal, ethical and technological risks of AI, ML and associated algorithms - koshiyama-et-al-2024-towards-algorithm-auditing-managing-legal-ethical-and-technological-risks-of-ai-ml-and-associated.pdf - Published Version

Download (2MB) | Preview

Abstract

­Business reliance on algorithms is becoming ubiquitous, and companies are increasingly concerned about their algorithms causing major financial or reputational damage. High-profile cases include Google’s AI algorithm for photo classification mistakenly labelling a black couple as gorillas in 2015 (Gebru 2020 In The Oxford handbook of ethics of AI, pp. 251–269), Microsoft’s AI chatbot Tay that spread racist, sexist and antisemitic speech on Twitter (now X) (Wolf et al. 2017 ACM Sigcas Comput. Soc. 47, 54–64 (doi:10.1145/3144592.3144598)), and Amazon’s AI recruiting tool being scrapped after showing bias against women. In response, governments are legislating and imposing bans, regulators fining companies and the judiciary discussing potentially making algorithms artificial ‘persons’ in law. As with financial audits, governments, business and society will require algorithm audits; formal assurance that algorithms are legal, ethical and safe. A new industry is envisaged: Auditing and Assurance of Algorithms (cf. data privacy), with the remit to professionalize and industrialize AI, ML and associated algorithms. The stakeholders range from those working on policy/regulation to industry practitioners and developers. We also anticipate the nature and scope of the auditing levels and framework presented will inform those interested in systems of governance and compliance with regulation/standards. Our goal in this article is to survey the key areas necessary to perform auditing and assurance and instigate the debate in this novel area of research and practice.

Type: Article
Title: Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms
Open access status: An open access version is available from UCL Discovery
DOI: 10.1098/rsos.230859
Publisher version: https://doi.org/10.1098/rsos.230859
Language: English
Additional information: © 2024 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Brain Repair and Rehabilitation
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10192998
Downloads since deposit
Loading...
53Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item