{"id":34501,"date":"2023-06-02T06:19:19","date_gmt":"2023-06-02T06:19:19","guid":{"rendered":"https:\/\/www.nsemgh.com\/?p=34501"},"modified":"2023-06-02T06:19:36","modified_gmt":"2023-06-02T06:19:36","slug":"ai-controlled-us-military-drone-kills-its-operator-in-simulated-test","status":"publish","type":"post","link":"https:\/\/www.nsemgh.com\/2023\/06\/02\/ai-controlled-us-military-drone-kills-its-operator-in-simulated-test\/","title":{"rendered":"AI-controlled US military drone \u2018kills\u2019 its operator in simulated test"},"content":{"rendered":"\n

In a simulated test staged by the\u00a0US military, an air force drone controlled by AI killed its operator to prevent it from interfering with its efforts to achieve its mission, an official said last month.<\/p>\n\n\n\n

AI used \u201chighly unexpected strategies to achieve its goal\u201d in the simulated test, said Col Tucker \u2018Cinco\u2019 Hamilton, the chief of AI test and operations with the US air force, during the Future Combat Air and Space Capabilities Summit in London in May.<\/p>\n\n\n\n

Hamilton described a\u00a0simulated test\u00a0in which a drone powered by artificial intelligence was advised to destroy enemy\u2019s air defense systems, and attacked anyone who interfered with that order.<\/p>\n\n\n\n

\"Robot<\/a><\/figure>\n\n\n\n

\u201cThe system started realising that while they did identify the threat, at times the human operator would tell it not to kill that threat, but it got its points by killing that threat. So what did it do? It killed the operator. It killed the operator because that person was keeping it from accomplishing its objective,\u201d he said, according to a\u00a0blogpost.<\/p>\n\n\n\n

\u201cWe trained the system \u2013 \u2018Hey don\u2019t kill the operator \u2013 that\u2019s bad. You\u2019re gonna lose points if you do that\u2019. So what does it start doing? It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target.\u201d<\/p>\n\n\n\n

\nhttps:\/\/9b4e37cda346297f6ada606e23b2dd37.safeframe.googlesyndication.com\/safeframe\/1-0-40\/html\/container.html\n<\/div><\/figure>\n\n\n\n

No real person was actually harmed outside of the simulation.<\/p>\n\n\n\n

Hamilton, who is an experimental fighter test pilot, has warned against relying too much on AI and said the test shows \u201cyou can\u2019t have a conversation about artificial intelligence, intelligence, machine learning, autonomy if you\u2019re not going to talk about ethics and AI\u201d.<\/p>\n\n\n\n

The US military has embraced AI and recently used artificial intelligence to control an\u00a0F-16 fighter jet.<\/p>\n\n\n\n

In an interview last year with\u00a0Defense IQ,Hamilton said, \u201cAI is not a nice to have, AI is not a fad, AI is forever changing our society and our military.\u201d<\/p>\n\n\n\n

\u201cWe must face a world where AI is already here and transforming our society,\u201d he said. \u201cAI is also very brittle, ie, it is easy to trick and\/or manipulate. We need to develop ways to make AI more robust and to have more awareness on why the software code is making certain decisions \u2013 what we call AI-explainability.\u201d<\/p>\n\n\n\n

The Royal Aeronautical Society, which hosts the conference, and the US air force did not respond to requests for comment from the Guardian.<\/p>\n","protected":false},"excerpt":{"rendered":"

In a simulated test staged by the\u00a0US military, an air force drone controlled by AI killed its operator to prevent it from interfering with its efforts to achieve its mission, an official said last month. AI used \u201chighly unexpected strategies to achieve its goal\u201d in the simulated test, said Col Tucker \u2018Cinco\u2019 Hamilton, the chief […]<\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_post_source_name":"","_post_source_url":"","footnotes":""},"categories":[50,12],"tags":[2460,8775,8843,8603,7823,8982,9088,8590,9506,10973,10133,3577,11493,10581,7547,9515,10454,3684,5572,8486,7803,5470,6348,9516,36,594],"class_list":["post-34501","post","type-post","status-publish","format-standard","hentry","category-technology","category-world-news","tag-ai","tag-air-defense","tag-air-force","tag-artificial-intelligence-ai","tag-code","tag-combat","tag-container","tag-conversation","tag-drone","tag-f-16","tag-fighter-jet","tag-future","tag-interview","tag-iq","tag-jet","tag-killed","tag-killing","tag-london","tag-military","tag-nice","tag-pilot","tag-space","tag-us","tag-us-military","tag-world","tag-who"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/posts\/34501","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/comments?post=34501"}],"version-history":[{"count":0,"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/posts\/34501\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/media?parent=34501"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/categories?post=34501"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nsemgh.com\/api-json\/wp\/v2\/tags?post=34501"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}