31 December 2019

Inside Palantir’s support of the Army’s massive data problem

by Billy Mitchell
Source Link

Palantir recently won a $110 million prototype contract to support a massive integration of data among the Army’s far-reaching and disparate systems.

It’s not a big dollar figure, as far as defense contracts go, but officials at the company and the service say it’s the start of work that will transform the way the Army thinks about, integrates and uses its data.

The Silicon Valley data analytics software company will support Army’s Vantage program, formerly known as the Army Leader Dashboard — an ambitious attempt to bring more visibility to the service’s data — unclassified and classified, structured and unstructured — through an integration, analytics and visualization platform. The four-year acquisition could be worth more than $400 million in total.

Palantir’s Doug Philippone, lead of global defense, described to FedScoop the scale of integration Vantage requires. The data comes from hundreds, perhaps thousands, of systems containing training databases, equipment inventories, personnel records and maintenance reports.


“The problem for Army’s leaders and commanders at every level is you’re trying to make decisions off of accurate data but the data is stored in so many places, it’s often very hard to figure out what’s going on,” Philippone said.

As the Army tries to move into the digital age, it hopes the program will weave all of this data together and “present information in a way that is immediately understandable and actionable for an everyday end-user,” according to an early solicitation document.

“Every command is pulling from similar datasets, but data has a ‘date/time’ stamp for truth,” Lt. Col. Rob Wolfe, Strategic Initiatives Group director and the lead for the dashboard project, said in a release from the Army earlier this year. “If we get to the point where we’ve successfully gotten all this data together and curated it so it’s trustable and reliable and timely, then anybody else who has a dashboard can leverage [Vantage] as their source of data. Then our leaders can talk apples-to-apples. We have to have one version of the truth for data.”

Palantir was one of five companies selected to create prototypes for Vantage, which was procured through what Philippone called a “rigorous” other transaction agreement (OTA). The other companies that competed were Microsoft, Accenture, Deloitte and Ernst & Young.

The OTA authority, which has existed for decades but was expanded in the 2016 National Defense Authorization Act, allows DOD to grant relatively small contracts for the development of prototypes and then follow on with an additional contract for production if and when the pilot is successful. This particular contract, however, was a bit of a nontraditional OTA in that it took more than a year to field a final prototype.

Now, Palantir’s work is underway, and Philippone confirms it is indeed “a massive data integration project.”

“What we did was integrate thousands and thousands of different data tables together so that you can make better decisions,” he said. “Just if you look at personnel, there’s something like 192 different systems that literally have thousands of tables inside of them where each table has up to 5 million rows. This is a very complicated data integration problem.”

The Army believes this program could revolutionize the way it approaches its data, Chérie Smith, program executive officer for enterprise information systems, said in July. “We have been focused for 20 or 30 years on transactions, and I think we’re going to start really, truly making that leap to focusing on the data and the information.”

Yet another year came and went with headlines dominated by the Pentagon’s JEDI saga.

While the Department of Defense finally issued an award for the Joint Enterprise Defense Infrastructure to bring an enterprise commercial cloud capability to the military, continued lawsuits mired the department’s hopes for swiftly implementing the program.

As 2019 began, Oracle’s protest of the single-award JEDI acquisition raged on, stalling the Department of Defense’s path to a contract and implementation. The company contended that DOD tailored the contract for cloud computing giant Amazon Web Services and that there was a conflict of interest between the Pentagon and AWS.

But by the year’s end, that protest would fall to second fiddle as, in an ironic turn, AWS issued its own bid protest of the acquisition after losing the JEDI competition to Microsoft. And now, the pre-implementation of JEDI, which has been in progress for an excess of two years, will continue into 2020.
Oracle’s protest

As it stands currently, Oracle has taken its protest of DOD’s handling of the JEDI acquisition all the way to a federal appeals court after falling short with the Government Accountability Office and the U.S. Court of Federal Claims.

Though the company hasn’t been successful in its litigation against the DOD, the court filings did slow the department’s progress somewhat in awarding the contract and put the acquisition under the spotlight of some of the most important leaders in Washington. Over the summer, President Trump told reporters that he was going to “take a very strong look at” the acquisition after receiving what he called “tremendous complaints” about the competition for the procurement in relation to Amazon.

Subsequently, Defense Secretary Mark Esper, new to the role, ignited his own internal review of the JEDI contract after receiving complaints from members of Congress.

In the meantime, top DOD IT officials were making their case for why the military needed this enterprise cloud capability as soon as possible.

“Delaying implementation of the JEDI Cloud will negatively impact our efforts to plan, fight, and win in communications compromised environments, and will negatively impact our efforts to improve force readiness and hampers our critical efforts in AI,” Lt. Gen. Bradford Shwedo, CIO of the Joint Chiefs of Staff, wrote in June. “This position has been forwarded and is supported by all of the U.S. Combatant Commands. Our adversaries are employing these technologies; our warfighters need this capability now.”

And while Esper was conducting his review of JEDI, the acquisition team behind it was still at work evaluating proposals from remaining contenders Microsoft and AWS.

“One thing I’ve been consistent on from the beginning is, we’ve got to get this right. So we are not going to rush to a decision,” DOD CIO Dana Deasy said in August. “We’re going to spend whatever time that the evaluation team needs to spend, to make sure we are picking the best technical solution at the right price with the right delivery criteria that will meet the needs of the warfighter.”

On Oct. 22, Esper, short of finishing his review of JEDI, recused himself from anything to do with the acquisition because his son works for IBM, one of the companies that initially bid for the contract but didn’t meet its initial gate criteria. He delegated his role in any decision-making around JEDI to Deputy Secretary David Norquist while the acquisition continued “to move to selection through the normal acquisition process run by career acquisition professionals,” according to a DOD spokesperson.

The timing of those moves was odd, though. It would later be revealed in AWS’s protest that DOD had already awarded the contract to Microsoft privately prior to Esper’s recusal.
Microsoft wins and AWS strikes back

Just days after Esper’s announced recusal, the moment that had been two years in the making finally came: DOD awarded JEDI. Microsoft beat out AWS for the up-to $10 billion contract.

“We brought our best efforts to the rigorous JEDI evaluation process and appreciate that DOD has chosen Microsoft,” Toni Townes-Whitley, president of U.S. regulated industries for Microsoft, said in a statement. “We are proud that we are an integral partner in DOD’s overall mission cloud strategy.”

AWS, on the other hand, was “surprised” by the decision. “A detailed assessment purely on the comparative offerings clearly lead to a different conclusion,” a company spokesman said.

Amazon filed a protest of the award decision and evaluation in the U.S. Court of Federal Claims in early November.

That protest was filed under seal but was eventually released with redactions in December. AWS claims in its litigation that overt political pressure from the top of the Trump administration led to “egregious errors” in the Pentagon’s evaluation of bids for the $10 billion Joint Enterprise Defense Infrastructure (JEDI) cloud contract and award to Microsoft. The company cites Trump’s summer press gaggle in which he referenced a JEDI review and other public and private statements as evidence of the president’s slant against the company and claims that it pervaded the DOD’s decision.

“What is most remarkable here is that consistent with the expressed desires of its Commander in Chief — DOD consistently and repeatedly made prejudicial errors, at every step along the way, that systematically favored Microsoft and harmed AWS — errors that grew in magnitude at each stage, and that mirrored the increasing tactics from President Trump to thwart the award of the contract to AWS,” reads the complaint. “The most plausible inference from these facts is simply this: under escalating and overt pressure from President Trump, DOD departed from the rules of procurement and complied — consciously or subconsciously — with its Commander in Chief’s expressed desire to reject AWS’s superior bid.”

AWS CEO Andy Jassy, at the company’s annual developer’s conference, said he couldn’t understand how his company could lose to Microsoft. “I think if you do a truly objective, detailed, apples-to-apples comparison of the platforms, you don’t end up in the spot where that decision is made,” Jassy told reporters at the re:Invent conference in Las Vegas. “Most of our customers tell us that we’re a couple years ahead, both with regard to functionality and maturity. And I think that you end up with a situation with significant political interference.”
What’s next?

Despite AWS’s protest, Microsoft and DOD are cleared to do initial planning for implementation of the contract. The two parties kicked off discussions about work under the contract Dec. 11-13. CEO Satya Nadella and members of the Microsoft Azure and public sector teams met with DOD CIO Dana Deasy and other senior defense IT leaders.

But until Feb. 11, DOD and Microsoft have agreed to hold off on work under JEDI, with the exception of “initial preparatory activities,” to let the federal claims court settle AWS’s dispute. Therefore, the court and parties involved will likely work to move quickly through the protest to prevent any further stay in work under the contract.
We use cookies to provide you with the best experience across all Scoop News Group websites. By using Scoop News Group websites, you consent to the use of cookies. 

No comments: