Editor’s Note: A PDF of this research briefing is available at this link.
DOI: https://doi.org/10.54813/FLTL8789
War-Algorithm Accountability
Dustin A. Lewis, Gabriella Blum, and Naz K. Modirzadeh
Harvard Law School Program on International Law and Armed Conflict
August 2016
In War-Algorithm Accountability (August 2016), we introduce a new concept—war algorithms—that elevates algorithmically-derived “choices” and “decisions” to a, and perhaps the, central concern regarding technical autonomy in war. We thereby aim to shed light on and recast the discussion regarding “autonomous weapon systems” (AWS).
We define “war algorithm” as any algorithm that is expressed in computer code, that is effectuated through a constructed system, and that is capable of operating in relation to armed conflict. In introducing this concept, our foundational technological concern is the capability of a constructed system, without further human intervention, to help make and effectuate a “decision” or “choice” of a war algorithm. Distilled, the two core ingredients are an algorithm expressed in computer code and a suitably capable constructed system.
Through that lens, we link international law and related accountability architectures to relevant technologies. We sketch a three-part (non-exhaustive) approach that highlights traditional and unconventional accountability avenues. We focus largely on international law because it is the only normative regime that purports—in key respects but with important caveats—to be both universal and uniform. In this way, international law is different from the myriad domestic legal systems, administrative rules, or industry codes that govern the development and use of technology in all other spheres. By not limiting our inquiry only to weapon systems, we take an expansive view, showing how the broad concept of war algorithms might be susceptible to regulation—and how those algorithms might already fit within the existing regulatory system established by international law.
Links
Report PDF
Web Version by Specific Section
Blog Posts
Lawfare Blog post: “Accountability for Algorithmic Autonomy in War,” Lawfare, September 12, 2016 (Gabriella Blum, Dustin A. Lewis, and Naz K. Modirzadeh)
PHAP Expert Briefing question-and-answer: “War algorithms and international law - Interview with Dustin A. Lewis,” October 10, 2016.
Research Assistants
Learning Resources
Algorithms
Introduction to Algorithms (SMA 5503 at MIT, Fall 2005) [link]
Design and Analysis of Algorithms (6.046J / 18.410J at MIT, 2012) [link]
Artificial Intelligence
Artificial Intelligence (6.034 at MIT, Fall 2010) [link]
Machine Learning
Machine Learning (Coursera) [link]
Neural Networks for Machine Learning (Coursera) [link]
An introduction to machine learning with scikit-learn [link]
Thinking Computationally
EVENTS
In this presentation, Prof. Ingvild Bode and Dr. Anna Nadibaidze will examine select global practices of developing, training personnel for, and using military systems integrating AI and autonomous technologies, covering some of these practices, their normative implications, and potential ways forward in addressing these challenges via governance frameworks.
HLS PILAC Senior Researcher Dustin A. Lewis participated in the Stockholm Security Conference, presenting new HLS PILAC research — produced as part of the “International Legal and Policy Dimensions of War Algorithms: Enduring and Emerging Concerns” project — at the breakout session titled “Artificial Intelligence (AI) and Human Control: How are Advances of AI and Autonomy in Weapons Systems Impacting the Roles of Humans in Warfare?”.
Inaugural Workshop of the Programme on the Ethics & Law of Trusted Autonomous Systems at Lady Margaret Hall, Oxford.
On October 4–5, 2018, HLS PILAC Senior Researcher Dustin Lewis participated in two panels at CyFy 2018, hosted by the Observer Research Foundation in New Delhi, India: “Algorithms, AI and Armed Conflict” and “Private Sector Tech and Militarisation.” Image credit: @benjaminang.
A Side Event at the 2017 Group of Governmental Experts on Lethal Autonomous Weapons Systems. Image credit: UN Geneva, “Palais des Nations & Ariana Park,” Flickr, CC BY-NC-ND 2.0.
PHAP Expert Legal Briefing by Naz Modirzadeh and Dustin Lewis on developments in technology, accountability, and international law pertaining to armed conflict. Image credit: Christiaan Colen, “Rootkit code,” Flickr, CC BY-SA 2.0.
Senior Researcher Dustin Lewis and Junior Research Fellow Jiawei He will take part in academic exchanges in China on the PILAC mapping exercise on autonomous (weapons) systems, accountability, and international law. Image credit: Christiaan Colen, “Source code security plugin,” Flickr, CC BY-SA 2.0.
[Write-up last updated: January 2017]