1 July 2026

Would Claude Refuse an Illegal Military Order?

The Atlantic | Shane Harris

The Maven Smart System, a military platform, integrates AI like Claude to fuse intelligence from satellite imagery, drone feeds, and communications intercepts, enabling officers to rapidly identify enemy unit locations, select weapons, and determine attack angles. This system, which can generate target lists in minutes, exemplifies Defense Secretary Pete Hegseth's "AI-first" warfighting strategy.

However, military investigators are scrutinizing the system after a Tomahawk cruise missile, guided by AI and human input, struck an elementary school in Minab, Iran, in February, killing approximately 170 people, mostly girls. The targeters believed they were hitting a naval installation. This incident raises critical questions about AI's role in lethal decision-making chains and the potential for disastrous errors when relying on such advanced systems for target selection.

No comments: