Hardback
Research Handbook on Meaningful Human Control of Artificial Intelligence Systems
This prescient Research Handbook analyses the ethical development of Artificial Intelligence systems through the prism of meaningful human control. It encapsulates a multitude of disciplinary lenses including technical, philosophical and legal, making a crucial contribution to the ongoing discourse about control and responsibility in the field of AI.
More Information
Critical Acclaim
Contents
More Information
This prescient Research Handbook analyses the ethical development of Artificial Intelligence systems through the prism of meaningful human control. It encapsulates a multitude of disciplinary lenses including technical, philosophical and legal, making a crucial contribution to the ongoing discourse about control and responsibility in the field of AI.
The Research Handbook combines empirical insights from various fields to examine the emergence of responsible AI development. These perspectives are discussed in relation to key topics including automated intelligent mobility, recommender and decision-support systems, cure and care, and AI in the military. Contributors examine diverse problems, requirements and context-specific approaches to responsible AI development, ultimately providing the reader with a transdisciplinary view of the subject and highlighting the way forward on both an individual and societal level.
Bringing together a wide range of experts, this Research Handbook is an essential read for scholars of science and technology, law, philosophy of technology, security studies and innovation policy. It also appeals to those involved in the development of AI technology and policy, from policymakers aiming to codify human-centric AI to computer scientists engaging in the design of responsible AI.
The Research Handbook combines empirical insights from various fields to examine the emergence of responsible AI development. These perspectives are discussed in relation to key topics including automated intelligent mobility, recommender and decision-support systems, cure and care, and AI in the military. Contributors examine diverse problems, requirements and context-specific approaches to responsible AI development, ultimately providing the reader with a transdisciplinary view of the subject and highlighting the way forward on both an individual and societal level.
Bringing together a wide range of experts, this Research Handbook is an essential read for scholars of science and technology, law, philosophy of technology, security studies and innovation policy. It also appeals to those involved in the development of AI technology and policy, from policymakers aiming to codify human-centric AI to computer scientists engaging in the design of responsible AI.
Critical Acclaim
‘The Research Handbook on Meaningful Human Control of Artificial Intelligence Systems provides an excellent collection of scholars from a number of fields who each, in turn, give substance and clarity to the thorny and dynamic concept of Meaningful Human Control (MHC). The Handbook carefully considers the multi-dimensionality of AI and its relationship to human agency, and offers one of the most comprehensive and thoughtful engagement with the ways in which MHC challenges us, while also offering ideas about how these challenges could be addressed, if not overcome. An important and much needed contribution to an ongoing debate.’
– Elke Schwarz, Queen Mary University of London, UK
‘This book is an outstanding collection of original essays on an extremely important contemporary set of problems pertaining to human control of AI systems. How can such control be engineered, and what is the relationship between accounts of the control implicated in human moral responsibility and those pertinent to AI systems? These questions and others are explored from an interdisciplinary perspective. The authors are first-rate and the editors have done a very fine job of organizing the collection. Very highly recommended!’
– John Martin Fischer, University of California, US
– Elke Schwarz, Queen Mary University of London, UK
‘This book is an outstanding collection of original essays on an extremely important contemporary set of problems pertaining to human control of AI systems. How can such control be engineered, and what is the relationship between accounts of the control implicated in human moral responsibility and those pertinent to AI systems? These questions and others are explored from an interdisciplinary perspective. The authors are first-rate and the editors have done a very fine job of organizing the collection. Very highly recommended!’
– John Martin Fischer, University of California, US
Contents
Contents
List of contributors vii
Acknowledgements x
1 Introduction to meaningful human control of artificially intelligent systems 1
Authors (listed in alphabetical order): David Abbink, Daniele Amoroso,
Luciano Cavalcante Siebert, Jeroen van den Hoven, Giulio Mecacci and
Filippo Santoni de Sio
PART I PHILOSOPHY AND ETHICS
2 Automated mobility and meaningful human control: when and why is
control important and what are its different dimensions? 13
Sven Nyholm
3 Reflection machines and the proximity scale of reasons: addressing
accountability asymmetry 28
Pim Haselager and Giulio Mecacci
4 Out of control: flourishing with carebots through embodied design 38
Anco Peeters
5 Meaningful human command: advance control directives as a method to
enable moral and legal responsibility for autonomous weapons systems 53
S. Kate Devitt
PART II LAW AND GOVERNANCE
6 Legal and governance perspectives on meaningful human control: the
case of automated mobility 82
Giuseppe Contissa
7 From “human control” in international law to “human oversight” in the
new EU act on artificial intelligence 105
Juliane Beck and Thomas Burri
8 Meaningful human control in shared medical decision making 133
Susanne Beck, Simon Gerndt, David Samhammer and Peter Dabrock
9 Meaningful human control: an international criminal law account 150
Marta Bo
PART III DESIGN AND ENGINEERING
10 Designing automated vehicle and traffic systems towards meaningful
human control 165
Simeon Calvert, Stig Johnsen and Ashwin George
11 Reflective hybrid intelligence for meaningful human control in
decision-support systems 191
Catholijn M. Jonker, Luciano Cavalcante Siebert and Pradeep K.
Murukannaiah
12 Meaningful human control of increasingly autonomous robots for surgery 208
Fanny Ficuciello, Mohammad Hossein Hamedani and Guglielmo Tamburrini
13 Designing for meaningful human control in military human-machine teams 235
Jurriaan van Diggelen, Karel van den Bosch, Mark Neerincx and Marc Steen
PART IV INTERDISCIPLIPARITY AND SYSTEMIC PERSPECTIVES
14 Too much control? Health, sex and war 257
Ezio Di Nucci
15 Worldbuilding a planet-positive future enabled by human + AI coevolution 267
Ann Pendleton-Jullian
16 Holistic bow-tie model of meaningful human control over effective
systems: towards a dynamic balance of humans and AI-based systems
within our global society and environment 313
Frank Flemisch, Marcel Baltzer, David Abbink, Luciano Cavalcante Siebert,
Jurriaan van Diggelen, Nicolas Daniel Herzberger, Mark Draper, Michael
Boardman, Marie-Pierre Pacaux-Lemoine, Joscha Wasser
List of contributors vii
Acknowledgements x
1 Introduction to meaningful human control of artificially intelligent systems 1
Authors (listed in alphabetical order): David Abbink, Daniele Amoroso,
Luciano Cavalcante Siebert, Jeroen van den Hoven, Giulio Mecacci and
Filippo Santoni de Sio
PART I PHILOSOPHY AND ETHICS
2 Automated mobility and meaningful human control: when and why is
control important and what are its different dimensions? 13
Sven Nyholm
3 Reflection machines and the proximity scale of reasons: addressing
accountability asymmetry 28
Pim Haselager and Giulio Mecacci
4 Out of control: flourishing with carebots through embodied design 38
Anco Peeters
5 Meaningful human command: advance control directives as a method to
enable moral and legal responsibility for autonomous weapons systems 53
S. Kate Devitt
PART II LAW AND GOVERNANCE
6 Legal and governance perspectives on meaningful human control: the
case of automated mobility 82
Giuseppe Contissa
7 From “human control” in international law to “human oversight” in the
new EU act on artificial intelligence 105
Juliane Beck and Thomas Burri
8 Meaningful human control in shared medical decision making 133
Susanne Beck, Simon Gerndt, David Samhammer and Peter Dabrock
9 Meaningful human control: an international criminal law account 150
Marta Bo
PART III DESIGN AND ENGINEERING
10 Designing automated vehicle and traffic systems towards meaningful
human control 165
Simeon Calvert, Stig Johnsen and Ashwin George
11 Reflective hybrid intelligence for meaningful human control in
decision-support systems 191
Catholijn M. Jonker, Luciano Cavalcante Siebert and Pradeep K.
Murukannaiah
12 Meaningful human control of increasingly autonomous robots for surgery 208
Fanny Ficuciello, Mohammad Hossein Hamedani and Guglielmo Tamburrini
13 Designing for meaningful human control in military human-machine teams 235
Jurriaan van Diggelen, Karel van den Bosch, Mark Neerincx and Marc Steen
PART IV INTERDISCIPLIPARITY AND SYSTEMIC PERSPECTIVES
14 Too much control? Health, sex and war 257
Ezio Di Nucci
15 Worldbuilding a planet-positive future enabled by human + AI coevolution 267
Ann Pendleton-Jullian
16 Holistic bow-tie model of meaningful human control over effective
systems: towards a dynamic balance of humans and AI-based systems
within our global society and environment 313
Frank Flemisch, Marcel Baltzer, David Abbink, Luciano Cavalcante Siebert,
Jurriaan van Diggelen, Nicolas Daniel Herzberger, Mark Draper, Michael
Boardman, Marie-Pierre Pacaux-Lemoine, Joscha Wasser
