AI made an error about a Chinese vessel, US called off operation — TechCrunch
In the United States, an armed operation against a Chinese vessel was called off at the last moment after officials discovered an error in intelligence data related to the work of an AI chatbot. By the time the error was discovered, military aircraft were already airborne, TechCrunch reports, citing CNN.
Error concerning the cargo
An intelligence report circulated during the war with Iran stated that the vessel was transporting components for a nuclear weapons program. According to CNN, an analyst at the US Special Operations Command used an AI chatbot to summarize open-source data and classified signals intelligence.
The chatbot incorrectly identified the vessel's cargo declaration. The analyst then used the tool a second time to format the erroneous conclusions as an official summary. This document was circulated through command channels, and the operation was later canceled.
More current news is available on the UA.News Telegram channel Telegram.
Risks of using AI
As TechCrunch writes, the US military is accelerating AI integration, seeking to make decisions faster and maintain an advantage over China. The Pentagon has described such technologies as a means to substantially speed up the kill chain. At the same time, the speed of the systems may contribute to the spread of errors if human oversight is insufficient.
GovAI research fellow and US Army veteran Jake Steckler said that service members must understand the uncertainty inherent in large language models. According to him, this is particularly important for decisions on the use of force, including targeting, intelligence analysis, and operational planning. Steckler believes that the incident should serve as grounds for strengthening safeguards rather than abandoning the technology.
