(Stockholm/Geneva, 2 June 2020) A new report from the Stockholm International Peace Research Institute (SIPRI) and the International Committee of the Red Cross (ICRC) identifies where controls on autonomous weapon systems must be placed. The authors highlight the need for human control over life-or-death decisions in warfare and offer practical guidance and concrete control measures for an international policy response. The full report is now available at the following link.
Autonomous weapon systems risk a loss of human control over life-or-death decisions in warfare
Autonomous weapon systems (AWS) have attracted criticism because they select and attack targets without human intervention.
Ensuring that humans remain in control of the use of force, especially life-or-death decisions in warfare, needs to be the key priority in setting limits on AWS, according to a new report from SIPRI and the ICRC.
‘The main concern is that AWS are triggered by the environment and the user does not know or choose the specific target,’ says Vincent Boulanin, Senior Researcher, SIPRI. ‘That unpredictability can make it challenging for AWS users to comply with international humanitarian law, address fundamental ethical concerns and maintain military control.’
The report argues that a common understanding of human control is an important step in mitigating the risks of AWS and offers an in-depth discussion of what type and degree of human control is needed and when that control should be implemented.
Control measures necessary to ensure human control over the use of force
Three types of control measure on AWS are identified as necessary for ensuring human control over the use of force, focusing on the design of the weapon, the environment it is used in, and the way that the user interacts with it.
‘The type and degree of human control needed has always been the difficult question,’ says Netta Goussac, Associate Senior Researcher, Armament and Disarmament, SIPRI and former Legal Adviser, ICRC. ‘The control measures identified in this report provide practical guidance for determining limits on autonomous weapon systems.’
The report is the first of its kind to outline specific control measures that can compensate for the unpredictability of AWS and lower the risks for civilians and fighters, taking into account different scenarios.
Call for an international policy response to the risks of AWS
According to the authors, the practical control measures identified in the report should inform an international policy response, whether in the form of a new treaty, standards or best practices.
‘The ICRC and others have been calling for a concerted international response to the risks of AWS,’ says Neil Davison, Scientific and Policy Adviser, Legal Division, ICRC.
‘The pace of military technology developments, including in artificial intelligence, only increases the urgency for states to agree on where the boundaries must be placed,’ says Davison. ‘To avoid serious risks for civilians and fighters, strict constraints will be needed.’
The report provides policymakers with practical guidance on how to translate the need for human control into concrete limits on the design and use of AWS, taking into consideration legal, ethical and operational concerns.
For editors
According to SIPRI’s and the ICRC’s definition, an autonomous weapon system is any weapon system that once activated can select and attack targets without human intervention.
This report is a cooperation between SIPRI and the ICRC and the work is financially supported by the Ministry for Foreign Affairs of the Netherlands, the Swedish Ministry for Foreign Affairs and the Swiss Federal Department of Foreign Affairs.
Media contacts
For information and interview requests contact SIPRI Communications Officer Alexandra Manolache (alexandra.manolache@sipri.org, +46 766 286 133) or SIPRI Communications Director Stephanie Blenckner (blenckner@sipri.org, +46 8 655 97 47).