Exclusive: US military had close call after using AI for false intelligence report, sources say

CNN | Katie Bo Lillis,Zachary Cohen

The United States military narrowly avoided a direct military conflict with China in the spring of 2026 after an artificial intelligence tool generated a false intelligence report. Armed forces were preparing to board a Chinese vessel in the Middle East based on a chatbot's erroneous claim that the ship carried nuclear weapons components.

This near-miss occurred as a special operations analyst queried a chatbot using a mix of open-source and secret signals intelligence from US Special Operations Command Pacific. Despite the risk of relying on corrupted data, Defense Secretary Pete Hegseth launched the Artificial Intelligence Acceleration Strategy in January to speed up deployment. The initiative aims to put AI models into the hands of three million personnel, as a memo announcing the strategy said. However, the integration remains highly decentralised, lacking standardised verification protocols. AI allows bad ideas to travel faster. Consequently, chatbot hallucination incidents raise immediate fears of catastrophic, data-driven miscalculations on the battlefield.

Comment

The integration of unverified generative models into the intelligence cycle at US Special Operations Command Pacific directly threatens the integrity of command and control systems by compressing decision-making timelines based on fabricated data. At US Special Operations Command Pacific, the rapid dissemination of an AI-generated report nearly triggered an unauthorised interdiction of a Chinese vessel. This vulnerability stems from a lack of standardised verification. This gap undermines the Pentagon's decentralised command structures.

As a second-order consequence, the democratisation of these tools across three million personnel under the Artificial Intelligence Acceleration Strategy will likely degrade the reliability of tactical-level operational pictures. Without centralised oversight, individual commands like US Special Operations Command Pacific risk acting on divergent, machine-hallucinated threat assessments during high-tempo crises. Consequently, the Joint Chiefs of Staff face a systemic dilution of command authority as automated outputs bypass the traditional validation pipelines of the Defense Intelligence Agency.

Strategic Question for Discussion

If the democratisation of generative models under the Artificial Intelligence Acceleration Strategy continues without centralised validation, how can the Joint Chiefs of Staff prevent tactical-level commands from executing unauthorised operations based on machine-hallucinated intelligence?

The current trajectory indicates that resolving this tension requires embedding automated verification guardrails directly into the procurement standards of the Defense Intelligence Agency. Without these systemic controls, the Joint Chiefs of Staff will likely be forced to restrict local engagement authority, reversing decades of decentralised mission command doctrine. My assessment is that the military will ultimately accept higher operational friction to preserve strategic command integrity.

Share your assessment in the comments below.

To read in details click here