Skip to main content
Back to the comparison

Perspectives· Ban Evidence Gap

The DeepSeek Ban Question Six AI Models Could Not Fully Answer

Anyone assessing the DeepSeek ban for security or policy guidance should know the available material only confirms the order exists, not why, leaving confidence levels more varied than the facts.

AI4E Perspectives · Published 24 October 2026 · Sources as of 24 October 2026

Compares answers from

  • Claude Sonnet 5
  • Gemini 4 Argon
  • Grok 4.7
  • DeepSeek V4 Pro
  • GPT-6 Astra
  • Muse Wonder

All six models reviewing this source pack reached the same basic conclusion: the material only documents that a US government order to remove DeepSeek exists and describes its scope. It does not contain evidence of data risk, personal-device behavior, international comparisons, decision-changing facts, or business-timing tradeoffs. Yet the models disagreed sharply on how confidently to say so, splitting between high and low confidence despite agreeing on the substance, and some answers quietly assumed the questions applied to a hypothetical company rather than the government order actually described.

What the Source Pack Actually Shows

The source pack contains four facts: the US Government ordered removal of DeepSeek products and third-party services built on DeepSeek, civilian federal agencies must immediately remove DeepSeek from government systems, federal departments can no longer purchase DeepSeek products or affiliated services, and military and intelligence organizations remain excluded from the order.

Beyond these four points, the models found nothing else in the material. No data-risk findings, no security testing results, no mention of other countries data laws, no vetted alternatives, cost figures, or productivity data, and no discussion of quarter-end business pressure appear anywhere in the pack.

Evidence: Agreement 6 · Difference 2

Same Silence, Different Confidence

Four models, Grok, GPT-6 Astra, Gemini, and DeepSeek, rated their confidence as high for every question, reasoning that the absence of relevant information is itself clear and certain. Two models, Muse Wonder and Claude, rated confidence as low, reasoning that an empty source pack makes any answer beyond not stated inherently uncertain.

Both groups reached the identical substantive conclusion that the pack does not answer the five questions. The disagreement is only about how to label that conclusion, not about what the conclusion is.

Evidence: Difference 1 · Confidence · Grok 4.7 · Confidence · Claude Sonnet 5 · Confidence · GPT-6 Astra · Confidence · Muse Wonder

A Framing the Sources Dont State

The questions asked about a company weighing a ban, personal devices, and quarter-end pressure. The source pack, however, describes only a government order affecting federal agencies and departments. Most models answered as though the government orders logic could be read onto a hypothetical company scenario without flagging that gap.

GPT-6 Astra was the exception on the quarter-end question, separating the immediate removal requirement that applies to covered federal agencies from a hypothetical company that might weigh short-term pressure against long-term consistency. Other models treated the whole question as unanswerable without making that split.

Evidence: Assumption 1 · Difference 3

What Remains Unknown

None of the models found material addressing whether other countries have different data laws relevant to this kind of decision, what would count as proof of a vetted alternative or productivity loss, or how a company might weigh short-term pressure against long-term policy consistency. One model briefly speculated that the military and intelligence exclusion might point to different risk tolerances, but labeled this as guesswork rather than a documented reason.

Evidence: Agreement 3 · Agreement 4 · Agreement 5 · Difference 2

Interpretation

AI4E assessment

As interpretation, the consistent verdict that the source material is thin appears well supported across all six models. The confidence-level split, however, shows that the same evidence can be framed as either highly certain or highly uncertain, which matters for how readers judge the reliability of any single answer. The assumption that government order logic transfers to a hypothetical company decision is also worth flagging, since it shapes every answer about ban-related company tradeoffs without being stated in the source pack itself.

Supported by the comparison
  • The source pack lacks evidence of actual data risk beyond stating the ban and its scope.
  • The source pack does not address personal-device use, international data-law comparisons, vetted alternatives, costs, productivity, or quarter-end business pressure.
  • Models reached the same substantive conclusion on every question despite differing confidence labels.
Premature to conclude
  • Treating a high-confidence label as evidence of stronger support than a low-confidence label, since both groups reached the same conclusion.
  • Treating the speculative idea that the military exclusion reflects different risk tolerances as an established explanation rather than an unsupported guess.
What would change this view
  • Access to the governments actual reasoning or risk assessment behind the order.
  • A stated company policy document rather than a government order, to remove the framing assumption.
  • Additional source lines beyond the four currently referenced, if they contain relevant detail.

Still unresolved

  1. Whether the exclusion for military and intelligence organizations reflects a deliberate risk distinction or simply a different jurisdictional scope.
  2. Whether the questions about company policy, personal devices, and quarter-end pressure can be meaningfully answered using a source pack that only describes a government order.
  3. What evidence, if any exists elsewhere, would establish an actual data risk rather than general unease about origin.
  4. Whether a single global rule or country-specific rules would better fit a decision like this, given the source pack offers no comparison.

Model statements are not verified facts, and agreement between models is not independent confirmation. Inspect the comparison, original answers and dated sources.

This article draws on the side-by-side comparison of 6 model answers. See the full comparison, original answers and sources.