Military Review

Killer robots stunned Ilona Musk and even more than a hundred specialists


Autonomous weapons or by autonomous weapons systems (AWS), military experts refer to types of weapons that they do everything themselves: both find the target and accomplish the task without human intervention. One of the most famous, so far only on science fiction films and books AWS are considered the so-called "killer robots."

Ilon Musk and over a hundred other robotics experts write in the open UN warning letter to the deadly threat from killer robots. Musk, Mustafa Suleiman, the creator of AI-company DeepMind Technologies, which is now owned by Google, and 114 experts from 26 countries warn the UN that an AWS arms race can open a Pandora’s box that can cause humanity to be hard to predict and cause very great harm. They demand to ban the development and implementation of autonomous weapons systems.

All signatories are well versed in the issue, because they work in the field of artificial intelligence (AI). They are confident that the entry into the armament of the armies of the developed countries of robots-killers will have the same significance for military affairs as the invention of gunpowder and nuclear weapons, which they call the first and second revolution in military affairs. AWS, they believe, will be the third revolution.

“After being brought to a high level, autonomous weapons systems will lead military conflicts to a degree of scope that humankind has not yet seen,” says a collective letter. - Moreover, it will happen with great speed. AWS can become a weapon of terror, a weapon that despots and terrorists will use against civilians ... ”

The authors of the letter warn about a hypothetical as yet weapon that can kill people without human intervention. The day is close when it will become a harsh reality from the category of fiction and will force you to look for answers to many complex questions, ranging from the safe management of such systems to moral and ethical problems caused by “iron” cruelty and unpredictability of deadly machines.

Musk, with supporters who share his position on the danger of AWS for humanity, emphasizes that there is no time for reflection and discussion, and that it is necessary to act immediately. “We have very little time,” they write to the UN. “Once the Pandora’s box opens, it will be very difficult to close it.”

The time for writing an open letter was not chosen randomly. The experts wanted to coincide with the beginning of work in Melbourne of the International Conference on Artificial Intelligence (IJCAI). It was supposed to open on Monday 21 August, but the UN decided to move it to November.

At the end of an open letter, Ilon Mask and his colleagues call on the UN to redouble their efforts to create a strategy by November to protect the planet from killer robots.

Previously, Musk himself warned about the dangers of works on artificial intelligence as such, since the systems based on it could get out of control of a person. At the same time, Tesla cars with electric motors already drive on the roads of the United States in unmanned mode, which is not without incident.

Subscribe to our Telegram channel, regularly additional information about the special operation in Ukraine, a large amount of information, videos, something that does not fall on the site:

Dear reader, to leave comments on the publication, you must sign in.
  1. MadCat
    MadCat 26 August 2017 06: 40
    soon ISKINs will be judged, removed from office and put to sleep in a cryoturge for the erroneous killing of these walking pieces of meat laughing
    1. Cat
      Cat 26 August 2017 07: 44
      It is more probable that pieces of meat that go around and interfere with steering along the roads of Iskina will be the “judge”! tongue
  2. Razvedka_Boem
    Razvedka_Boem 26 August 2017 06: 48
    R. Sheckley has a good story on this subject - Birdwatch.
    You can recall S. Lem with his Iyon Tychy on the moon, where military training grounds were brought to the moon and the evolution of weapons was under the supervision of AI. The result was a nanoweapon. The same author described it well in nf The Invincible novel.
    1. Cat
      Cat 26 August 2017 07: 53
      Which of the science fiction writers was the first moot point! But history knows two pioneers who formulated the "three zakov robotic technology." True, they "blame authorship" on each other.
      Quote from the wiki:
      In 1939, Isaac Asimov began to write the first of his stories about robots, the story "Robbie" (born Robbie). In 1941, Asimov wrote the story “Liar” (English Liar!) About a robot that could read minds. The famous Three Laws of Robotics begins to appear in this story. Asimov attributed the authorship of these laws to John W. Campbell, who formulated them in a conversation with Asimov on December 23, 1940. Campbell, however, said that the idea belonged to Asimov, he only gave her the wording. In the same story, Asimov coined the word "robotics" (robotics, the science of robots), which was included in the English language. In translations of Asimov into Russian, robotics also translate as “robotics”, “robotics”.

      The next storybook "I, Robot" is a classic of the world of fantasy!
      1. Zheleznostop
        Zheleznostop 26 August 2017 09: 08
        Fantasy kind of about hobbits, elfofv.
        1. Cat
          Cat 26 August 2017 11: 06
          You are right, I generalized the concepts. If you specify the genre, then - science fiction.
          By the way, your nickname has an analogue with R. Tolkin "sherstolap"! laughing
          Do not be offended!
    2. voyaka uh
      voyaka uh 26 August 2017 12: 43
      Whether Shekli was the first, not Shekley, but this time has come. Much faster than expected.
      And Musk, not in vain worried. He is one of those few who sees far ahead.
      1. Cherry Nine
        Cherry Nine 26 August 2017 13: 35
        Quote: voyaka uh
        He is one of those few who sees far ahead.

        What's the point?

        Text of the letter

        Suppose, holy people from the UN say (basically, I will remind, consisting of thieves, cannibals and professional liars), that the terminators are ah-ah-ah. So what? Israel, for example, immediately close the shop? What about Hezbollah?

        It seems that Musk, Google and all the other gang-watering from San Francisco decided once again to be promoted in the genre of make love notes thief.
        1. voyaka uh
          voyaka uh 26 August 2017 19: 00
          A gang of water from San Francisco determines what technology we all have tomorrow.
          They cannot forbid any direction of technology, but they can force politicians to come up with legislation introducing this direction in advance into a certain framework.
          For example, it is impossible to ban the development of new poisons, but it is clear to anyone that no new poison can be used in the form of chemical weapons.
          1. Cherry Nine
            Cherry Nine 26 August 2017 19: 20
            Quote: voyaka uh
            For example, it is impossible to ban the development of new poisons, but it is clear to anyone that no new poison can be used in the form of chemical weapons.

            And what, stools have not yet been forbidden to use in the form of blunt weapons? What a nuisance. It should be banned.

            Or here NURSy. Is it possible to prohibit shelling NURSami, say, Sderot? This is because they are shelling him because the UN has not introduced this direction into a certain framework? Who should I write a letter to?
  3. vladimirvn
    vladimirvn 26 August 2017 08: 09
    By PR uncle decided. Looks like he’s not going very well.
    1. Laughtermaster
      Laughtermaster 26 August 2017 13: 33
      It just removes competitors in advance.
    2. saturn.mmm
      saturn.mmm 27 August 2017 08: 08
      Quote: vladimirvn
      By PR uncle decided. Looks like he’s not going very well.

      Things are going well with him.
  4. Settlement Oparyshev
    Settlement Oparyshev 26 August 2017 08: 48
    the topic is relevant, but progress cannot be stopped in any way. If drones strive to be massive, then no one will cancel it. Another question. The elite will isolate themselves from drones by drones and will conduct virtual wars with the people through the Ironmen and Letaki. As long as you play, fight in tanks, preparing a game in which copters will fight with you.
    1. igordok
      igordok 26 August 2017 09: 11
      Quote: p-k Oparyshev
      If drones aspire to be massive, then no one will cancel it.

      Those. drones will create drones of their own kind. recourse
      1. Settlement Oparyshev
        Settlement Oparyshev 26 August 2017 13: 46
        Why will they be? Already stamped, for decades, this VO is as always ready for the last War.
      2. yehat
        yehat 28 August 2017 10: 52
        no, they will learn to breed like flies :)
  5. Moryarty
    Moryarty 26 August 2017 09: 29
    There are three threats from AI:
    1) The most likely threat is the possibility of using such robots by dictators and terrorists. Robots are ruthless and simply carry out any order, no matter how cruel it may be.
    2) The AI ​​is getting out of control of the manager, and stopping it is very difficult. But this is the most unlikely scenario.
    3) Very likely in the near future. Robots will replace workers, as well as police and soldiers. Any discontent will be crushed with cruelty (robots do not know pity). As a result, a handful of the rich will control the whole world, and destroy those who disagree with the help of insensitive machines.
    1. Laughtermaster
      Laughtermaster 26 August 2017 13: 41
      So far, proto-threat-fooling and subsequent panic have been launched.
    2. Cherry Nine
      Cherry Nine 26 August 2017 13: 46
      Quote: Moryarty
      a bunch of rich will control the whole world

      Zionist Occupational Government, release 666.1488 beta test.

      Until now, dictatorships, genocides, and other popular amusements have been quite successful at very low levels of technology. Nagan in hand and go!

      Quote: Moryarty
      The most likely threat is the possibility of using such robots by dictators and terrorists.

      And by a funny coincidence, it’s precisely these people who are deeply fucked both by the Mask and the UN
  6. andrewkor
    andrewkor 26 August 2017 09: 31
    They thought the same about dynamite, about machine guns, only nuclear weapons still somehow justify hopes!
  7. Bob 57
    Bob 57 26 August 2017 10: 44
    USA from Russia with love to partners!
    1. Greenwood
      Greenwood 26 August 2017 15: 53
      Yeah, the partners got really scared!
  8. Free wind
    Free wind 26 August 2017 11: 10
    and he walks now dumbfounded !!!!!! Headers have become .........
  9. Evgeny Strygin
    Evgeny Strygin 26 August 2017 14: 33
    what all the same fuss with this pushing the name "Mask" into all the inaccessible cracks.
    1. tforik
      tforik 26 August 2017 16: 39
      well, when there is someone to shove)
  10. tforik
    tforik 26 August 2017 15: 44
    Sensible fellow is Elon Musk. It is a pity that in our country there is no such road.
    1. Cat
      Cat 26 August 2017 16: 50
      Elon Musk - smart? belay
      But your statement that “in our country there is no such road” has bothered me more than anything! I immediately had the association "Crowd of Clones Mask rushing along a whitewashed parallel highway"! wink laughing
      1. vadim dok
        vadim dok 26 August 2017 18: 38
        Remember Zvorykin, Sikorsky, Brin and many many others!
      2. voyaka uh
        voyaka uh 26 August 2017 19: 08
        "Elon Musk - sensible?" /////
        Here I agree with you. To call the Mask "sensible" is how to call Chaliapin a "good singer."
        40 Falcon-9 launches, including 15 with the return of the first stage, of which 1 this year (Roscosmos - 12). Sensible guy.
        1. Vadim237
          Vadim237 26 August 2017 20: 39
          It’s just that the guy got down to business in the right direction, at the right time and in the right place - that’s rapidly gaining height.
          1. Cherry Nine
            Cherry Nine 26 August 2017 22: 13
            Quote: Vadim237
            The guy just got down to business in the right direction, at the right time and in the right places.

            Not quite "simple."
            In terms of missiles, Musk is the difference between Falcon 9 and Antares from Orbital ATK, which was created at the same time, on the same assignment, for more money and a much larger and more experienced company.
        2. yehat
          yehat 28 August 2017 10: 56
          Is it the merit of the Mask?
          I think it’s rather a merit of NASA, which finances it, generously shares its experience and trained personnel
          I personally consider Musk a talented PR manager, nothing more.
          1. Cherry Nine
            Cherry Nine 2 September 2017 20: 15
            Quote: yehat
            I think it’s rather a merit of NASA, which finances it, generously shares its experience and trained personnel

            The program Commercial Resupply Services worked more than one SpaceX. And SpaceX did much better than others. That is the difference. And the merit is Mask or the people whom Musk hired, i.e. mask anyway.
            Under this program, the Americans would have one Antares and the second something like him - there would be a fundamentally different alignment in the launch industry.
  11. Michael_Zverev
    Michael_Zverev 26 August 2017 19: 22
    These devices are reminiscent of “air wafers” that the hooligans in the basements once painted. laughing
    In general, such devices are really very dangerous, and the development of technology makes them more accessible. It’s quite possible to put together a regular drone, a cell phone with face recognition, a gun and some explosives now, several dozens, or even hundreds of such devices, on roofs, somewhere in London, for example, and let go on a hunt at rush hour. Bonus - black faces are poorly recognized, shooting will be mostly more or less bright. smile
  12. Popovich
    Popovich 26 August 2017 20: 33
    Elon Musk - Terminator 4 (lite version)
  13. Decabrev
    Decabrev 26 August 2017 22: 16
    Musk voiced only that which has long been clear to everyone. And, in general, this is PR. Similarly, many wanted to ban nuclear weapons. The result is zero. Anyone does not have nuclear weapons just because their manufacture requires very serious resources. I'm afraid that there will be no such problems with drones and other fully autonomous weapons. The elemental base is getting cheaper and cheaper. Software to steal or adapt similar from the civilian sphere, also, most likely it will be possible. Maybe I'm wrong. Let the experts correct.
    1. Michael_Zverev
      Michael_Zverev 26 August 2017 22: 53
      I’m not a specialist at all, but it doesn’t seem technically difficult for me: they already know how to recognize a person’s figure and face, self-drones are already available, it’s easy to equip a firing device and a small explosive charge to self-detonate to use up ammunition. One student made a drone with a pistol in 2015.
  14. Oleg7700
    Oleg7700 27 August 2017 18: 37
    As has repeatedly happened in history, current "forecasts and fears" may turn out to be akin to the "scientific" forecasts of the time that "the development of urban public transport is impossible to reach a certain limit, because of the problem of removing horse manure from the streets" and the real danger is completely different . As for the doctrine of Israel: “... situational awareness alone is not enough if it is not linked to the ability to respond within the same time interval. Since these time intervals currently amount to seconds and fractions of a second, a person’s abilities create limitations. Consequently, the concept of Fire Canopy includes the development of an automated response along with situational awareness. " Elbit Systems' second-generation Tzayad (Digital Land Army) system will become the main element uniting all this together, “closing the circuit”, work is in full swing and the UN-Shmaon, together with the “concerned public”, are not advisers: - well not to go hand to hand ...
    1. voyaka uh
      voyaka uh 27 August 2017 23: 27
      "includes the development of automatic response along with situational awareness" ////

      This is half the trouble ... recourse the trouble is that situation-aware devices with self-learning software will automatically respond. I.e
      Software written (gradually, according to situations) by themselves, and not by human programmers. And what the robot will program for itself, God knows. This is what the technology guru warns about.
      1. Oleg7700
        Oleg7700 28 August 2017 00: 08
        There is something to work for the Israeli guru from logistics and AI. "You want to live;
        1. voyaka uh
          voyaka uh 28 August 2017 10: 30
          Israel, of course, deals with this. And strengthen the army, of course.
          And, as I suppose, Israeli firms will earn
          AI a lot of money. But the weather still does California.
          They are noisy in the press.
  15. Leonid Har
    Leonid Har 28 August 2017 04: 37
    Elon Musk warns everyone about the dangers of artificial intelligence, but he continues to develop artificial intelligence. It’s strange. Is not it?
    1. voyaka uh
      voyaka uh 28 August 2017 10: 26
      Development is unstoppable. And naturally, Silicon Valley firms and
      Seattle - in the forefront. But it’s also natural that they warn of possible
      the consequences of their own development. For the first time, it became clear that AI exists, it has already been developed, and it is a weapon.
      And it’s not stupid to think in advance about the legislation in this area.
      1. yehat
        yehat 28 August 2017 10: 58
        What can stop the thirst for power and profit?
        AI is a means of extracting all this and no moral standards can stop the villains.
  16. DimerVladimer
    DimerVladimer 28 August 2017 15: 22
    It’s one thing when AI acts according to the established program and is bound by its limitations.
    Another thing, when the possibility of self-learning is provided, is to edit your code that is not bound by any restrictions of an ethical plan.
    Experts are trying to warn - Humanity, with its own hands, puts an end to fate.

    With the advent of mining farms (computing power for cryptocurrency settlements), huge amounts of distributed computing power not controlled by governments will become relatively accessible to AI.
  17. Mestny
    Mestny 29 August 2017 00: 13
    Quote: voyaka uh
    And it’s not stupid to think in advance about the legislation in this area.

    Yes indeed. And it will turn out like with atomic weapons - they did not have time to celebrate complete superiority over the rest of humanity, as it immediately appeared in another country, and then in the following. I had to persuade "not to distribute" for a long and tedious.
    It is necessary, it is urgently necessary to ban all others, except an exceptional country.
  18. ML-334
    ML-334 29 August 2017 06: 27
    The Creator Paradox created us-biorobots with the “Commandment of God” program — are we fulfilling them? Does this and that-imagine God from us-will be punished. By the way, how many civilizations did he clean out?
  19. solovald
    solovald 30 August 2017 06: 45
    Everything follows Bradbury’s script in Birdwatch