Killer Drones With AI Will Leave Humankind 'Utterly Defenceless' Warns Expert

28/05/2015 09:31 | Updated 28 May 2016

Humans could be left "utterly defenceless" by small and agile flying robots that think for themselves and are designed to kill, a leading US computer science expert has warned.

The deadly drones are the likely "endpoint" of the current technological march towards lethal autonomous weapons systems (Laws), according to Professor Stuart Russell from the University of California at Berkeley.

stealth drone

'Call of Duty: Advanced Warfare' portrayed a world dominated by swarms of 'self aware' drones.

Weapons which will be controlled by artificial intelligence, not humans, could be as little as 10 years away, said the professor.

He added: "The stakes are high: Laws have been described as the third revolution in warfare, after gunpowder and nuclear arms."

Professor Russell isn't the only expert that's called for tighter regulation on Artificial Intelligence. Renowned physicist Professor Stephen Hawking has warned on numerous occasions that AI 'could spell the end of the human race'.

Writing in a comment article published in the journal Nature, Professor Russell worryingly argues that these drones will be limited not by intelligence, but by their own physical constraints of speed, mobility and firepower.

He continued: "As flying robots become smaller, their manoeuvrability increases and their ability to be targeted decreases. They have a shorter range, yet they must be large enough to carry a lethal payload - perhaps a one-gram shaped charge to puncture the human cranium.

"Despite the limits imposed by physics, one can expect platforms deployed in the millions, the agility and lethality of which will leave humans utterly defenceless. This is not a desirable future."

Prof Russell called on his peers - AI and robotics scientists - and professional scientific organisations to take a position on Laws, just as physicists did over nuclear weapons and biologists over the use of disease agents in warfare.


BAE Systems recently unveiled 'Taranis' an unmanned stealth drone concept that would provide reconnaissance and attack capabilities.

"Doing nothing is a vote in favour of continued development and deployment," he cautioned.

Tesla founder and entrepreneur Elon Musk is among those who have called for tighter regulation on AI warning that by introducing artificial intelligence without regulation we are 'summoning the demon', adding that he was truly afraid of what the future could hold.

But the three countries at the forefront of the technology - the US, UK and Israel - all insist they have internal weapons review processes that ensure compliance with international law, making such a treaty unnecessary, said Prof Russell.

The United Nations has held a number of meetings on Laws under the auspices of the Convention on Certain Conventional Weapons (CCW) in Geneva.


At the latest meeting in April, attended by Prof Russell, several countries - notably Germany and Japan - demonstrated strong opposition to lethal autonomous weapons.

Almost all states agreed with the need for "meaningful human control" over targeting and engagement decisions made by the machines. "Unfortunately the meaning of 'meaningful' is still to be determined," said Prof Russell.


The US Navy is currently testing a 'swarm' drone that would join with possibly hundreds of others to 'overwhelm' an enemy target.

He stressed that it was "difficult or impossible" for current AI systems to satisfy the subjective requirements of the 1949 Geneva Convention on humane conduct in war, which emphasise the need for military necessity, discrimination between combatants and non-combatants, and proper regard for the potential of collateral damage.

Prof Russell added: "Laws could violate fundamental principles of human dignity by allowing machines to choose who to kill - for example they might be tasked to eliminate anyone exhibiting 'threatening behaviour'.

"The potential for Laws technologies to bleed over into peacetime policing functions is evident to human rights organisations and drone manufacturers.

"In my view, the overriding concern should be the probable endpoint of this technological trajectory."

  • 1 Invisible Death Ray
    This is the US Military's Active Denial System, or ADS. It's a truck-mounted high-powered microwave weapon that when directed at a person or crowd can produce a severe burning sensation of the skin. The Pentagon worked on the system in the hopes of finding a non-lethal crowd control weapon that could replace the water cannon. It's non-radioactive, non-lethal and safe to use, however it has caused controversy over the effects it causes to the body.
  • 2 Hypersonic Missile
    The X-51A WaverRider is a terrifying response to America's increasing military commitments around the globe. Using a revolutionary scram jet engine, the missile is able to reach the hypersonic speed of Mach 5. Once trials are completed it will give the US Military a missile that can hit any target in the world from the US, within an hour.
  • 3 Giant Laser Cannon
    The laser cannon has arrived, no longer will it be relegated to SyFy TV shows and Star Wars. The US Navy's directed energy weapon fires a highly concentrated laser at incoming targets and is capable of destroying drones, small boats and missiles. While the laser is highly advanced the military designed it to be easy to use with game controllers being the main form of input.
  • 4 Robot Soldiers
    The QinetiQ MAARS or Modular Advanced Armed Robotic System, is essentially a small robot tank. It's a track-based robot that happens to contain a large machine gun, grenade launcher and a myriad of targeting sensors. While the weapons are controlled by a human, the robot has been designed for defence and patrol so it'll use in-built AI to help it follow troops or patrol a base.
  • 5 Self-Aiming Rifle
    The TrackingPoint XS1 poses a worrying question for the future of armed warfare. With a state-of-the-art connected scope, the holder simply tags the target and the gun's sensors work out distance, wind speed and elevation showing you exactly where you need to aim. Gone are the days of sharpshooters, replaced instead with scopes that'll work through Google Glass and help you fire through walls.
  • 6 The Railgun
    The railgun started life as a mythical weapon that often appeared in video games and sometimes showed its face in films (Transformers: Revenge of the Fallen). Using electromagnets to hurl a metal slug at hypersonic speeds, this weapon is the future of artillery and small arms, and now the US Navy has one. Constructed by BAE Systems, the railgun prototype can fire a metal slug at over Mach 6 and at a target over 110 kilometres away.
Suggest a correction