Perched on a mountaintop, straddling the border of Afghanistan and Pakistan, Paul Scharre\u2019s Army Ranger sniper team was scoping out routes Taliban fighters were suspected of using to move between the countries. <\/p>\n\n\n\n
They had gotten into position under the cover of darkness; they were spotted early in the morning by a farmer, Scharre writes in Army of None<\/em>, his book about autonomous weapons and the future of war.<\/p>\n\n\n\n \u201cNow, what we expected to happen was that some fighters would come to attack us,\u201d Scharre tells Freethink. \u201cAnd we were ready for that.\u201d<\/p>\n\n\n\n Sure enough, someone does head out of the village and moves towards Scharre\u2019s position. But this is not a Taliban fighter; down the sights of his sniper rifle is a young girl, perhaps just five or six, with two goats in tow.<\/p>\n\n\n\n She began \u201cherding\u201d the goats, Scharre writes, taking long, slow loops and looking at the sniper team\u2019s position. A radio she is carrying chirps.<\/p>\n\n\n\n \u201cThey sent a little girl to scout on our position,\u201d Scharre says.<\/p>\n\n\n\n Scharre does not pull the trigger, of course. It was never an option, even under the extremely dangerous circumstances. But what if a human being wasn\u2019t there to make that choice? What if an autonomous weapons system had spotted the girl, and acted according to its programming? <\/p>\n\n\n\n \u201cIf you programmed a robot to comply perfectly with the laws of war,\u201d Scharre says, \u201cit would have killed this little girl.\u201d<\/p>\n\n\n\n \u201cIs it acceptable for a machine to make life and death decisions in war?\u201d<\/p>Paul Scharre<\/cite><\/blockquote>\n\n\n\n Autonomous weapons aren\u2019t science fiction, aren\u2019t some distant concern, aren\u2019t the nightmare-inducing, shiny skeleton Terminators or even the bumbling battle droids (roger, roger<\/a>) of the Star Wars<\/em> prequels.<\/p>\n\n\n\n They\u2019ve existed, with varying levels of autonomy, for hundreds of years, and they are getting more sophisticated all the time. Today, powered with deep learning AI<\/a> and advanced computer vision technology, autonomous weapons can exhibit a range of \u201cfreedom\u201d that has never been achieved before in warfare. <\/p>\n\n\n\n An autonomous weapons system housed on a drone may have seen combat in 2020 in Libya<\/a>, and in 2020, Israeli agents assassinated<\/a> Iran\u2019s top nuclear scientist using a robotic sniper.<\/p>\n\n\n\n Their proponents believe that if autonomous weapons are more accurate, more precise, and kill only their intended targets, it may mean less death and less casualties, both for the militaries deploying them and the civilians caught in the crossfire. It may also mean removing the psychological and emotional burden of death from more people.<\/p>\n\n\n\n Opponents believe that to expect a machine to be able to handle the chaotic environment of a battlefield, to operate perfectly in a crowded city, to not suffer one of those weird errors AI<\/a> often makes \u2014 with deadly consequences \u2014 is unrealistic and dangerous. <\/p>\n\n\n\n And they argue that, far from a benefit, relieving human beings from the moral and tactical burden of deciding when to kill a person \u2014 deliberately losing control of a weapon \u2014 is an ethical nightmare that cannot be allowed to happen.<\/p>\n\n\n\n “Killer robots change the relationship between people and technology by handing over life and death decision-making to machines.<\/span>“<\/p>The Campaign to Stop Killer Robots<\/cite><\/blockquote><\/figure>\n\n\n\n It\u2019s that final concern that separates the autonomous weapons of today from those we\u2019ve used before: the ability to actively hunt down and attack targets, with no final human say on pulling the trigger.<\/p>\n\n\n\n It\u2019s a question at the heart of the debate around autonomous weapons, as militaries develop them and arms control and humanitarian organizations, like the Campaign to Stop Killer Robots<\/a>, seek a ban.<\/p>\n\n\n\n \u201cIs it acceptable,\u201d Scharre asks, \u201cfor a machine to make life and death decisions in war?\u201d<\/p>\n\n\n\n \u201cAutonomous weapons\u201d conjures up images of Predator drones and robot dogs, but the use of weapons that can act on their own is actually centuries old.<\/p>\n\n\n\n Mines, both on land and at sea, are passive autonomous weapons. Once they have been set, they do not need to be told to kill. Instead, they have sensors designed to detect the presence of someone or something, which triggers them to do their thing. They highlight that autonomous weapons do not need \u201cintelligence.\u201d<\/p>\n\n\n\n What mines do<\/em> have, however, is patience; they can lie in wait for decades, killing any who cross their path. They do not know a war is over. <\/p>\n\n\n\n Army of None<\/em> also recounts autonomous weapons systems of the past that seem advanced even today. Militaries have been developing weapons which can wander around a certain area seeking targets \u2014 known as \u201cloitering munitions\u201d \u2014 for decades.<\/p>\n\n\n\n In the 1980s, the U.S. Navy designed and tested a loitering missile called the Tomahawk Anti-Ship Missile (TSAM). <\/p>\n\n\n\n The idea was that you could launch the TSAM over the horizon, where you suspected Soviet ships would be. Once it arrived at its destination, the TSAM would fly a search pattern, looking for Soviet radar signals. If it found one, it would attack the source. <\/p>\n\n\n\n The TSAM was taken out of service in the 1990s, and never used in combat, but it was the first fully operational autonomous weapon of the modern era, Scharre writes.<\/p>\n\n\n\n Another loitering munition that is<\/em> in use is the Israeli-made Harpy. This drone circles around a specific area and hones in on signals used by radar devices, which it then attacks. According to Scharre, the Harpy can stay airborne for two and a half hours, covering 500 km of ground \u2014 and it can do so without a human in the loop.<\/p>\n\n\n\n Today\u2019s autonomous weapons can exhibit a range of \u201cfreedom\u201d that has never been achieved before in warfare.\u00a0<\/p><\/blockquote>\n\n\n\n And it is the humans \u2014 not the technology \u2014 that are actually at the heart of the fight for the future of war. Could autonomous weapons reduce the burden on human life, by avoiding mistakes? They may lead to less trauma, psychological and physical, for people fighting the wars. Or would they make war too easy, thus making it more common? <\/p>\n\n\n\n \u201cIf we had a war, and no one felt bad about the fact that we were killing other human beings, what would that say about us?\u201d Scharre asks.<\/p>\n\n\n\n \u201cWhat would it say about us if no one slept uneasy at night afterwards?\u201d<\/p>\n\n\n\n Which leads to the<\/em> question: Should autonomous weapons be banned \u2014 and can they be?<\/p>\n\n\n\n The proponents of autonomous weapons, including powerful militaries and major defense contractors, see great upside in them. <\/p>\n\n\n\n Writing in Military Review<\/a>, the Army\u2019s professional journal, Amitai Etzioni and Oren Etzioni, the CEO of Seattle\u2019s Allen Institute for AI, lay out some of the primary advantages of autonomous weapons systems for those deploying them.<\/p>\n\n\n\n Autonomous weapons are \u201cforce multipliers.\u201d This means that a commander can use fewer people for a mission, as the capabilities of each person are enhanced. You could imagine one drone operator destroying an entire convoy, rather than dispatching dozens or hundreds of soldiers with anti-vehicle weapons.<\/p>\n\n\n\n That technology could be deployed in places or conditions too dangerous for conventional troops, and, of course, fewer soldiers at risk means fewer soldiers killed.<\/p>\n\n\n\n Some military experts and roboticists believe autonomous weapons have moral benefits, as well.<\/p>\n\n\n\n The Etzionis quote roboticist Ronald C. Arkin, who argues that \u201cthey do not need to be programmed with a self-preservation instinct, potentially eliminating the need for a \u2018shoot-first, ask questions later\u2019 attitude.\u201d Their orders would not be colored by emotions like fear, they could be used to monitor and report human war crimes without bias, and removing humans from high-stress combat zones could help preserve their mental health.<\/p>\n\n\n\n But many of those benefits are based on the assumption that autonomous weapons work correctly. Already, Teslas are befuddled by road conditions, and phone-unlocking cameras have problems with certain skin colors. Could those systems be trusted to work with much higher stakes?<\/p>\n\n\n\n The argument for banning autonomous weapons outright has been taken up by almost 100 countries and the United Nations<\/a>.<\/p>\n\n\n\nThe Future of Conflict<\/strong><\/h3>\n\n\n\n
A Brief History of <\/strong>Autonomous Weapons<\/strong><\/h3>\n\n\n\n
To Build or To Ban<\/strong><\/h3>\n\n\n\n