CNN: AI Error Nearly Sparked War Between US and China
An intelligence report, circulated among U.S. military circles in the spring of this year amid the war with Iran, triggered an immediate state of alert, as it claimed that a Chinese vessel in the Middle East was transporting components linked to a nuclear weapons program, according to CNN.
According to CNN, four sources familiar with the incident stated that the U.S. military moved to develop plans to intercept the ship, with armed military personnel even preparing to board it. Two additional sources—one of whom had participated in the earlier intelligence sharing—reported that military aircraft were already airborne.
Officials did not ascertain the truth until just before the planned operation began. Upon scrutinizing the report prepared by an analyst attached to the Special Operations Command, they discovered it had been produced with the assistance of artificial intelligence. The chatbot used by the analyst had incorrectly identified the nature of the materials being carried by the ship. However, the actual nature of the misidentified cargo remained unknown.
CNN reported that one source described the report as “completely wrong,” while noting that it “nearly ignited a war,” since any U.S. operation against a Chinese vessel carried the risk of escalating into an armed conflict between the two countries.
In this specific incident, the analyst had queried a chatbot about intelligence information regarding the ship’s cargo list, originally provided by the U.S. Special Operations Command in the Pacific region (headquartered in Hawaii). It remained unclear whether the chatbot used was commercially available or affiliated with the U.S. government.
The chatbot combined open-source intelligence with classified intelligence gathered through government-held communications signals, arriving at its consequential conclusion about the nature of the materials the ship was transporting.
According to the CNN report, the analyst then used artificial intelligence again to format the findings into a standard intelligence report—the type of document trusted by military officials—and it was subsequently disseminated.
