28 May 2025

For DOD, the future of large language models is smaller

PATRICK TUCKER

The U.S. military is working on ways to get the power of cloud-based, big-data AI in tools that can run on local computers, draw upon more focused data sets, and remain safe from spying eyes, officials from OpenAI, Scale AI, and U.S. European Command told Defense One, part of a special broadcast airing Thursday.

When civilians query OpenAI’s ChatGPT, for example, their answers are generated by machines trained on huge amounts of data acquired from third-party sources and millions of user interactions a day. But the government has also hired OpenAI to make need-specific tools built on smaller and more unique datasets, said Sasha Baker, OpenAI’s head of national security policy.

Baker cited the company’s recent work for U.S. national laboratories on nuclear weapons safety.

“They deal with very, very sensitive data, as you might imagine, as a nuclear lab. And so it was absolutely critical for us to figure out a way to make sure that both sides felt good about the security environment,” she said.

The company spearheaded a new form of generative AI that feels like a large language model trained on massive public datasets but that does not need to reach beyond a secure perimeter and perform tasks far more complex than writing a white paper or developing a business plan.

“We're now starting to see the first scientific papers coming out of the labs where they actually cite GPT as a contributor, or, in some cases, even a co-author, of some of the scientific work that they're doing,” Baker said.

Baker also said the company is already offering products that meet FedRAMP security requirements for secret and top-secret information.

Other AI tools are helping combatant commands to integrate vast new information streams. U.S. European Command has joined the Maven program run by the National Geospatial-Intelligence Agency with support from Palantir, said David Wilts, EUCOM’s chief data and artificial intelligence officer.

No comments: