TRAX Sues U.S. Army Over Alleged AI Hallucinations in $450 Million Contract

TRAX International Corporation has filed a lawsuit against the U.S. Army, alleging that artificial intelligence hallucinations corrupted the evaluation of its bid for a major defense contract. The case, brought before the U.S. Court of Federal Claims, marks a significant legal test of how AI-generated errors impact federal procurement.

At the center of the dispute is a $450 million contract for mission support services at the White Sands Missile Range. The Army ultimately awarded the contract to Southwest Range Services. TRAX argues that the Army's Source Selection Evaluation Board (SSEB) relied on AI-generated errors that were never verified by human reviewers, leading to an unfair award decision. In its filing, TRAX described a specific weakness identified in its proposal as a "classic AI hallucination," claiming the evaluation contained made-up references to the proposal that went unchecked before being sent to the Source Selection Authority.

The Regulatory Gap

This legal battle highlights a critical void in current federal procurement policy. While existing acquisition rules define who holds decision-making authority, there are currently no specific federal rules governing the use of AI during the bid evaluation process. Consequently, there are no standardized requirements for how agencies must validate AI outputs or the extent to which they can rely on automated tools to determine the technical merit of a proposal.

Prior to the lawsuit, TRAX attempted to challenge the decision through the Government Accountability Office (GAO). The GAO denied the bid protest, though it did acknowledge that a "harmless error" had occurred when a weakness was assigned to TRAX. However, the GAO ruled that this specific error did not prejudice TRAX's overall chances of winning the award.

Industry Implications

The outcome of this case could set a major legal precedent for the transparency of federal contracting. If the lawsuit survives an initial motion to dismiss, the discovery process may compel the government to reveal its internal AI evaluation methods. Such a disclosure would likely force a shift in how agencies document the role of technology in their decision-making processes to avoid being labeled "arbitrary and capricious" by the courts.

For the defense industry, a ruling in favor of TRAX could lead to stricter human-validation standards and a requirement for agencies to disclose the use of AI in their solicitations upfront. This would ensure that contractors understand the tools being used to judge their technical capabilities.

What to Watch

Legal observers are now waiting to see if the court will allow the case to proceed to discovery. The primary point of contention remains whether the Army's reliance on the SSEB's findings—which TRAX claims were AI-driven—constitutes a failure of due process. Until a ruling is reached, the exact internal workflow the Army used to evaluate the White Sands Missile Range bids remains unconfirmed.