Lethal autonomous weapons
reflections on human-machine interaction
DOI:
https://doi.org/10.21680/1982-310X.2023v16n1ID35714Keywords:
Lethal autonomous weapons, International human rights law, International humanitarian law, Human-machine interactionAbstract
This article aims to reflect on the norms of international human rights law and international humanitarian law and the human role in the decision-making cycle of lethal autonomous weapons. First, it presents the concept of autonomous weapons systems and their international debate. It then discusses whether international human rights law and international humanitarian law require a degree of human involvement in the context of the use of autonomous weapons systems. It then reflects on two of the main concepts debated in the international context in relation to autonomous weapons: meaningful human control and appropriate levels of human judgment. Finally, it concludes that there is a duty of human involvement and that states must find ways to reach an agreement on human-machine interaction sufficient to comply with the norms of international human rights law and international humanitarian law.
Downloads
References
AMOROSO, Daniele. Autonomous Weapons Systems and International Law: A Study on Human-Machine Interactions in Ethically and Legally Sensitive Domains. Napoli: Edizioni Scientifiche Italiane, 2020.
ASARO, Peter. Jus Nascendi: Robotic Weapons and the Martens Clause. In R. Calo, M. Froomkin, & I. Kerr (Eds.), Robot Law. Cheltenham: Edward Elgar Publishing, 2016.
ASSEMBLEIA GERAL DAS NAÇÕES UNIDAS (UNGA). Declaração Universal dos Direitos Humanos. UNGA res 217 A(III) (UDHR), 1948.
BARBOSA, Lutiana. Forthcoming- AUTONOMOUS WEAPONS SYSTEMS AND THE RESPONSIBILITY OF STATES: Challenges and possibilities. CRC Press - Taylor & Francis Group. ISBN: 978-1-032-69232-6, 2024.
BARBOSA, Lutiana; MACEDO, Gustavo. Should We Be Optimistic About the Recent UN Talks on Killer Robots? Pass Blue, 22 de agosto de 2022. Disponível em: https://www.passblue.com/2022/08/29/should-we-be-optimistic-about-the-recent-untalks-on-killer-robots/. Acesso em: 24 de março de 2024.
DAVISON, Neil. A legal perspective: Autonomous weapon systems under international humanitarian law. UNODA Occasional Papers No. 30 Perspectives on Lethal Autonomous Weapon Systems, 2017. Disponível em https://www.icrc.org/en/download/file/65762/autonomous_weapon_systems_under_international_humanitarian_law.pdf Acesso em 24 de março de 2024.
KANT, Immanuel. Groundwork of the Metaphysics of Morals (Translated and edited by Mary Gregor. Cambridge: Cambridge University Press, 1998.
INTERNATIONAL COURT OF JUSTICE. Corfu Channel Case, Judgment. ICJ Rep 1949, 1949.
INTERNATIONAL MILITARY TRIBUNAL SITTING AT NUREMBERG. Trial of German Major War Criminals. Proceedings. Part 22 (1946), 1946. Disponível em: https://avalon.law.yale.edu/imt/09-30-46.asp Acesso em 24 de março de 2024.
KALLENBORN, Zachary. Russia may have used a killer robot in Ukraine. The Bulletin, 15 de março de 2022. Disponível em
https://thebulletin.org/2022/03/russia-may-have-used-a-killer-robot-in-ukraine-nowwhat/. Acesso em: 21 de março de 2024.
MAURI, Diego. Autonomous Weapons Systems and the Protection of the Human Person: An International Law Analysis. Cheltenham: Edward Elgar Publishing, 2022.
INTERNATIONAL COMMITTEE OF THE RED CROSS (ICRC). Rule 1. The Principle of Distinction between Civilians and Combatants. In IHL Database Customary IHL. Disponível em: https://ihl-databases.icrc.org/customary-ihl/eng/docs/v1_rul_rule1 Acesso em Acesso em: 21 de março de 2024.
CONSELHO DA EUROPA (2018a). Protocol amending the Convention for the Protection of Individuals with regard to Automatic Processing of Personal Data, 10 de outubro de 2018, ETS No. 223 Disponível em: https://rm.coe.int/16808ac918. Acesso em Acesso em: 21 de março de 2024.
CONSELHO DA EUROPA (2018b). Explanatory Report to the Protocol amending the Convention for the Protection of Individuals with regard to Automatic Processing of Personal Data Disponível em: https://rm.coe.int/cets-223-explanatory-report-to-the-protocol-amending-the-convention-fo/16808ac91a. Acesso em Acesso em: 21 de março de 2024.
CONSELHO DE SEGURANÇA DAS NAÇÕES UNIDAS (UNSC). Letter dated 8 March 2021 from the Panel of Experts on Libya established pursuant to resolution 1973 (2011) addressed to the President of the Security Council. S/2021/229. 8 de março de 2021. Disponível em: https://undocs.org/S/2021/229. Acesso em Acesso em: 21 de março de 2024.
GROUP OF GOVERNMENTAL EXPERTS OF THE HIGH CONTRACTING PARTIES TO THE CONVENTION ON PROHIBITIONS OR RESTRICTIONS ON THE USE OF CERTAIN CONVENTIONAL WEAPONS WHICH MAY BE DEEMED TO BE EXCESSIVELY INJURIOUS OR TO HAVE INDISCRIMINATE EFFECTS (CCW). Final Report of the 2019 session of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems 13–15 November 2019 (CCW/MSP/2019/9) Annex III Guiding Principles affirmed by the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems. 13 de dezembro de 2019.
MERON T, DENISON CL. Marco Sassòli and Antoine Bouvier, in cooperation with Laura M. Olson, Nicolas A. Dupic and Lina Milner (2000). How Does Law Protect in War? Cases, Documents, and Teaching Materials on Contemporary Practice in International Humanitarian Law. Genebra: International Committee of the Red Cross, 2000. International Review of the Red Cross. https://doi.org/10.1017/s1560775500184779.
SALIBA, Aziz; BARBOSA, Lutiana. Book review - Autonomous Weapons Systems and International Law: A Study on human-machine interactions in ethically and legally sensitive domains. Brazilian Journal of International Law, v. 17, p. 601-603, 2021. Disponível em: https://www.publicacoesacademicas.uniceub.br/rdi/article/view/7550. Acesso em: 24 de março de 2023.
UNITED NATIONS EDUCATIONAL, SCIENTIFIC AND CULTURAL ORGANIZATION (UNESCO). Recommendation on the Ethics of Artificial
Intelligence. SHS/BIO/PI/2021/1. 2021. Disponível em: https://unesdoc.unesco.org/ark:/48223/pf0000381137. Acesso em: 21 de março de 2024.
UNITED STATES DELEGATION. Human-Machine Interaction in the Development, Deployment and Use of Emerging Technologies in the Area of Lethal Autonomous Weapons Systems Submitted by the United States, CCW/GGE.2/2018/WP.4 (28 August 2018)
https://reachingcriticalwill.org/images/documents/Disarmament-fora/ccw/2018/gge/documents/GGE.2-WP4.pdf Acesso em 24 de março de 2024.
UNITED STATES, Department of Defense (US DoD). Directive n. 3000.09. 21 de novembro de 2012. Disponível em: https://www.esd.whs.mil/portals/54/documents/dd/issuances/dodd/300009p.pdf. Acesso em: 14 de novembro 2022.
UNITED STATES, Department of Defense (US DoD). Directive n. 3000.09. 25 de janeiro de 2023. Disponível em: https://media.defense.gov/2023/Jan/25/2003149928/-1/-1/0/DOD-DIRECTIVE-3000.09-AUTONOMY-IN-WEAPON-SYSTEMS.PDF. Acesso em: 10 de março de 2023.
UNITED NATIONS. Convention on Prohibitions or Restrictions on the Use of Certain Conventional Weapons Which May be Deemed to be Excessively Injurious or to Have Indiscriminate Effects (and Protocols) (As Amended on 21 December 2001) (CCW). 1342 UNTS 137, 1983.
UNITED NATIONS OFFICE FOR DISARMAMENT AFFAIRS. Retaining Meaningful Human Control of Weapons Systems, 2018. Disponível em: https://disarmament.unoda.org/update/retaining-meaningful-human-control-of-weapons-systems/. Acesso em: 23 de março de 2024.
UNITED NATIONS OFFICE FOR DISARMAMENT AFFAIRS. Experts Reflect on Novel Approaches to “Meaningful Human Control”, 2023. Disponível em: https://disarmament.unoda.org/the-convention-on-certain-conventional-weapons/experts-reflect-on-novel-approaches-to-meaningful-human-control/. Acesso em: 23 de março de 2024
VERRI, Pietro; MARKEE, Edward. Dictionary of the International Law of Armed Conflict. Genebra:International Committee of the Red Cross, 1992. Disponível em: https://www.icrc.org/en/publication/0453-dictionary-international-law-armed-conflict. Acesso em: 10 de outubro de 2022.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Revista Digital Constituição e Garantia de Direitos
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Autores mantêm os direitos autorais pelo seu artigo. Entretanto, repassam direitos de primeira publicação à revista. Em contrapartida, a revista pode transferir os direitos autorais, permitindo uso do artigo para fins não- comerciais, incluindo direito de enviar o trabalho para outras bases de dados ou meios de publicação.
