top of page

OpenAI and DeepSeek Distillation Evidence Complicates the Latest Technology News Fight

Aug 15
12 min read

OpenAI and DeepSeek are facing a new conflict signal after researchers tested whether model behavior can reveal hidden training relationships. The study adds empirical evidence to technology news previously dominated by company logs, political accusations, and unverifiable architectural claims.

The June 19 research paper does not prove that OpenAI copied DeepSeek, or that DeepSeek copied OpenAI. Instead, it introduces a behavioral auditing method and finds possible connections among OpenAI’s GPT-OSS, DeepSeek-R1, Alibaba’s QwQ, and OpenAI’s o1.

That distinction matters because Washington has framed unauthorized distillation by Chinese laboratories as potential technology theft. China has rejected those accusations, while American laboratories have rarely disclosed every model supplying their synthetic training data.

The new research challenges both sides. It supports the idea that distillation can leave detectable traces, but it also suggests modern model families form an entangled chain rather than a simple American-teacher, Chinese-student relationship.

A Behavioral Test Adds Evidence Beyond API Traffic

The immediate change is methodological: researchers now claim they can search for a teacher model inside a student’s behavior.

The distillation detection study came from researchers affiliated with the University of California, Berkeley, the University of Southern California, and OpenAI. It describes a technique called reference-based membership inference.

Membership inference tests whether particular material probably appeared during training. The new method adapts that idea to ask whether one model learned from another model’s outputs.

A direct comparison between two finished models usually produces ambiguous results. Models trained on similar internet data can share facts, wording, reasoning patterns, and benchmark strategies without copying each other directly.

The researchers address that ambiguity by adding an earlier checkpoint from the student’s own family. They measure whether the newer model became more aligned with a candidate teacher than its earlier relative was.

Suppose an auditor wants to examine a newer QwQ model. The auditor compares its preference for DeepSeek-R1 outputs against the preferences of an earlier QwQ checkpoint.

A larger shift toward DeepSeek-R1 can indicate that DeepSeek outputs influenced the newer QwQ model. The reference model acts as a baseline, helping remove similarities that already existed within the QwQ family.

This relative comparison is the paper’s main contribution. Common alternatives, including lexical overlap and raw output likelihood, performed poorly in several controlled experiments.

The researchers created 24 student models using combinations of four base students, three teachers, and two prompt collections. They retained 19 cases where distillation improved the student’s measured utility.

Their reference-based method identified the correct teacher with near-perfect accuracy across those retained controlled cases. It also recovered DeepSeek-R1 as the known teacher for six of seven tested real-world distilled models.

Those results establish that behavioral detection can work under selected conditions. They do not establish universal accuracy across every frontier training pipeline.

The strongest setting contains one teacher, one final supervised fine-tuning stage, accessible reasoning traces, and a suitable earlier checkpoint. Commercial models frequently violate several of those assumptions.

Even so, the approach changes the evidence available to investigators. Until now, leading laboratories largely relied on account records, payment links, IP addresses, and unusual query patterns.

Anthropic says those signals helped it identify coordinated campaigns involving DeepSeek, Moonshot AI, and MiniMax. Its February 23 disclosure alleged more than 16 million Claude exchanges across about 24,000 fraudulent accounts.

Behavioral auditing starts from the opposite end. Instead of watching how training data gets collected, it looks for a residual signal inside the resulting model.

That approach could help auditors examine open-weight models after release. It could also support investigations when an API provider lacks complete access logs or never observed the original traffic.

For readers following technology news, this is the central development. The dispute now includes an experimental model-level test, not only competing statements from laboratories and governments.

OpenAI Distillation Evidence Creates an Awkward Reversal

The study’s most politically sensitive result is not its DeepSeek finding, but its uncertain signal around OpenAI’s GPT-OSS models.

The researchers examined GPT-OSS-20B and GPT-OSS-120B against candidate teachers including DeepSeek-R1, QwQ, OpenAI o1, Claude, and Llama models. DeepSeek-R1 and QwQ-32B-Preview ranked highest in their analysis.

That ranking raises the possibility that GPT-OSS learned from the same reasoning lineage associated with DeepSeek-R1, QwQ, and o1. It does not establish a direct transfer from DeepSeek to OpenAI.

The evidence is weaker than the paper’s controlled results. GPT-OSS lacks a suitable earlier checkpoint from the same family, so the researchers used GPT-2 XL as a reference.

GPT-2 XL is separated from GPT-OSS by years of research and substantial architectural change. The paper explicitly warns that this temporal and technical gap makes the reference unreliable.

The authors therefore label their GPT-OSS interpretation highly uncertain. They present it as an open question requiring better reference models and further analysis.

That caution should govern every discussion of OpenAI distillation evidence. A high ranking among selected candidates is not a complete training record, and an omitted teacher can distort attribution.

There is another complication. DeepSeek-R1 and QwQ may themselves contain signals inherited from OpenAI models, including o1.

The study’s separate glyph test examines unusual Unicode behavior associated with o1 and o3. Controlled students distilled from o1 showed larger differences between Unicode and ASCII representations than most control models.

DeepSeek-R1 displayed a substantial Unicode signal in the open-ended analysis. The authors say this suggests possible o1-style influence, while stopping short of definitive attribution.

GPT-OSS also displayed a statistically detectable Unicode pattern across the tested reference models. The paper says that result could place it inside the same broader o1, DeepSeek-R1, and QwQ lineage.

This creates a chain rather than a clean reversal. GPT-OSS might resemble DeepSeek because both systems inherited behavior from o1, because GPT-OSS learned from DeepSeek, or because multiple stages combined those paths.

Rewriting adds another uncertainty. One model can generate an answer, while another model rewrites that answer before it enters the student’s training set.

A detector might identify the original generator, the rewriter, both systems, or neither. The paper does not yet resolve that scenario.

The result still pressures the American side of the political argument. U.S. officials have often described frontier knowledge as moving mainly from American providers toward Chinese competitors.

A potential signal running through GPT-OSS complicates that directional story. It suggests influence can circulate through public datasets, benchmark solutions, reasoning traces, and several generations of synthetic data.

This does not make all forms of distillation equivalent. Authorized use of open outputs differs from fraudulent access through coordinated accounts, just as internal distillation differs from competitor extraction.

However, technical ancestry alone cannot determine whether a transfer was authorized. Behavioral evidence must be combined with licensing terms, access records, training disclosures, and applicable law.

The new OpenAI distillation evidence therefore creates a narrow but meaningful reversal. American laboratories seeking attribution standards must accept that those standards can also be applied to American models.

DeepSeek Model Distillation Remains a Serious Allegation

The possible GPT-OSS connection does not erase substantial evidence that Chinese laboratories queried American models for training-related outputs.

Anthropic’s distillation findings describe infrastructure-level evidence rather than behavioral similarity. The company says it linked coordinated activity to DeepSeek, Moonshot, and MiniMax with high confidence.

According to Anthropic, the campaigns used fraudulent accounts and proxy services to evade regional restrictions and platform defenses. Repeated prompts targeted reasoning, coding, tool use, computer control, and other valuable capabilities.

Anthropic attributed more than 150,000 exchanges to DeepSeek. It says synchronized traffic, shared payment methods, and identical patterns indicated load balancing across accounts.

The company attributed more than 3.4 million Claude interactions to Moonshot. Its account described hundreds of fraudulent accounts targeting reasoning, coding, vision, data analysis, and computer operation.

These remain company claims, although Anthropic says industry partners corroborated some infrastructure indicators. Outside researchers cannot independently inspect all relevant account data.

The behavioral study adds a different kind of support to DeepSeek model distillation concerns. Its reference-based test ranked o1 and QwQ-32B-Preview near the top when examining DeepSeek-R1.

The Unicode diagnostic also identified an o1-style signal in DeepSeek-R1. The reported gap was statistically distinguishable from zero across 100 probes.

Yet the authors call the result preliminary. Their controlled validation covers a simplified training process, while DeepSeek-R1 likely reflects several data sources, training phases, and reinforcement methods.

A behavioral fingerprint also cannot reveal whether access violated a contract. It identifies a possible technical relationship, not the legal circumstances surrounding that relationship.

This boundary matters because knowledge distillation itself is standard practice. A laboratory can use its own larger model to train a smaller version, or use outputs permitted by another model’s license.

The dispute concerns adversarial distillation, meaning large-scale capability extraction through unauthorized or deceptive access. The contested conduct includes fake accounts, hidden proxy networks, and targeted collection designed for model training.

A June policy analysis argues that such campaigns create a strategic vulnerability for American AI providers. It also acknowledges major measurement problems.

Analysts cannot easily isolate how much capability a model gained from distilled data. Doing so would require comparable training runs with and without the suspected material.

Those runs would also require access to private base checkpoints, proprietary training data, and the collected teacher outputs. Outside researchers rarely possess all three.

Benchmark patterns offer weak evidence by themselves. Chinese models may approach American systems on coding and mathematics because those skills transfer well through distillation.

The same pattern could emerge because Chinese developers prioritize commercially useful technical tasks. Similar benchmark results cannot separate those explanations.

The paper’s QwQ case illustrates the promise and danger of inference. DeepSeek-R1 ranked highest when researchers compared QwQ-32B against its QwQ-32B-Preview reference.

The public timeline supports that possibility. QwQ-32B-Preview appeared in November 2024, DeepSeek-R1 followed in January 2025, and QwQ-32B arrived in March 2025.

Timing makes the proposed relationship possible, but timing is not proof. Alibaba could have used overlapping datasets, public DeepSeek outputs, internal methods, or several teachers.

DeepSeek model distillation should therefore remain a specific allegation supported by multiple evidence types. It should not become a universal explanation for Chinese model quality.

That distinction protects legitimate investigation. Overstating weak evidence gives accused companies an easy reason to dismiss stronger infrastructure records and access violations.

Washington’s Policy Case Now Faces a Technical Audit

The real opponent in this fight is not OpenAI versus DeepSeek, but political certainty versus incomplete technical attribution.

The Trump administration has separated legitimate distillation from covert industrial extraction. That line supports open model development while preserving a basis for sanctions and trade restrictions.

A July 24 policy account reported that officials accused Moonshot of distilling Anthropic’s Claude Fable model. Officials described ordinary efficiency work as legitimate but covert extraction as unacceptable.

China responded on July 27 by accusing the United States of “AI hegemonism.” Its commerce ministry threatened countermeasures against actions that caused substantive harm to Chinese interests.

The Chinese response followed warnings about possible sanctions, investigations, and Entity List restrictions. Moonshot denied achieving Kimi K3’s performance through distillation.

Moonshot attributed its gains to original architectural changes. That claim has not been independently verified through access to its complete training process.

U.S. officials face a similar disclosure problem. American laboratories publish technical reports, but those documents seldom enumerate every external model used for evaluation, grading, rewriting, or synthetic data.

The new detection method can pressure all developers toward clearer records. Auditors could compare claimed model ancestry against behavioral evidence and investigate large discrepancies.

However, policymakers should not treat a detector score as a verdict. The paper’s accuracy drops when the true teacher is missing from the candidate pool or calibration encounters an unfamiliar teacher.

In controlled cross-validation, accuracy reached 82.9 percent when generalizing across unseen students. It fell to 60.5 percent when generalizing across unseen teachers.

That difference is crucial for real investigations. An auditor rarely knows every possible teacher, and the most important source may be a private or unreleased checkpoint.

The method also detected reasoning teachers more reliably than a non-reasoning Llama teacher. A weak fingerprint could produce a false negative even when distillation occurred.

Conversely, entangled lineages can produce misleading rankings. If teacher A influenced teacher B, a student trained on B may retain behavior that resembles A.

No model-level detector currently answers the legal question alone. It cannot determine whether outputs came from a paid API, an open dataset, an authorized partnership, or coordinated fraudulent accounts.

A defensible enforcement case needs several layers of evidence. Investigators should combine provider logs, financial records, account infrastructure, model behavior, release timelines, and training disclosures.

Governments also need a stable definition of prohibited extraction. Calling all training on model-generated text “theft” would implicate common practices across the industry.

A narrower definition can focus on deception, access-control evasion, material scale, and targeted capability acquisition. Those factors are easier to distinguish from ordinary evaluation or permitted synthetic-data generation.

This framework would also reduce nationality-based assumptions. A Chinese model should not be presumed copied because it performs well, and an American model should not receive automatic immunity.

The technology news debate becomes more credible when evidence standards apply symmetrically. That symmetry will matter if behavioral audits continue finding cross-border influence in both directions.

What the Detection Method Still Cannot Prove

The research offers a useful audit signal, but its open-world findings remain too uncertain for a definitive accusation against any laboratory.

The paper’s first limitation is its single-teacher assumption. Contemporary frontier models can use several systems for generating solutions, grading answers, rewriting text, and creating preference data.

A student trained through that pipeline has multiple teachers serving different roles. The current method assumes at most one candidate teacher supplied the relevant final-stage signal.

Its second limitation is the focus on supervised fine-tuning. Frontier development also includes pretraining, reinforcement learning, rejection sampling, tool-generated feedback, and human preference optimization.

A model could absorb another system’s behavior during any of those stages. The resulting trace may look different from the controlled fine-tuning signature.

The third limitation concerns references. Strong attribution requires an earlier checkpoint that closely matches the student’s family and training state.

QwQ offers a plausible earlier preview model, which makes its result easier to interpret. GPT-OSS lacks that equivalent public checkpoint, forcing the researchers to use GPT-2 XL.

That mismatch weakens the central GPT-OSS claim. It is the main reason the authors describe the proposed connection as highly uncertain.

The fourth problem is missing teachers. A detector can rank only the candidates it examines, even when the true source is absent.

The strongest candidate may simply be the least-wrong option. Open-world testing tries to address that problem with thresholds, but calibration remains sensitive to teacher type.

The fifth problem is shared public data. Models can become behaviorally similar after training on the same benchmark solutions, code repositories, academic papers, or synthetic datasets.

Some datasets openly publish outputs from named reasoning systems. Training on those records can create a technical dependency without any direct API extraction.

The sixth limitation is intentional obfuscation. Developers can paraphrase outputs, mix teachers, filter stylistic markers, or train against detectors once the audit techniques become known.

A visible fingerprint can encourage its own removal. That dynamic already appears in research examining whether watermarks survive downstream model training.

The seventh concern is institutional independence. One paper author lists an OpenAI affiliation, and the research received support involving OpenAI, Ai2, and Apple.

That does not invalidate the method or results. It does make independent replication especially important when findings enter geopolitical disputes involving OpenAI.

Researchers should reproduce the tests with new prompt sets, alternative references, larger candidate pools, and hidden ground-truth models. They should also test mixed-teacher and rewritten datasets.

Companies can help by publishing intermediate checkpoints and fuller data-provenance statements. A provenance record documents which models and datasets influenced each training stage.

Those records would let auditors compare declared dependencies with measured behavior. They would also distinguish routine internal distillation from undisclosed competitor extraction.

Enterprise buyers have a practical reason to care. A model’s undocumented ancestry can create licensing, security, supply-chain, and regulatory risks.

A company deploying a model for coding or sensitive analysis needs more than benchmark scores. It needs to understand how the model was trained and whether upstream access could trigger restrictions.

Teams evaluating claims should preserve source material, dates, and technical reports in a searchable system. A structured AI knowledge base helps separate primary evidence from repeated commentary.

The right conclusion is cautious. Behavioral auditing is becoming feasible, but a feasible signal is not yet a forensic standard.

Three Signals Will Decide What Happens Next

The next phase depends on replication, enforcement evidence, and voluntary model-provenance disclosures.

The first signal is independent replication of the reference-based method. Researchers need to reproduce its controlled accuracy and test its failure modes on unfamiliar model families.

A successful replication should include multi-teacher training, rewritten outputs, hidden candidates, and several reference checkpoints. Consistent results would strengthen behavioral detection as a practical audit tool.

Failure to reproduce the GPT-OSS ranking would weaken the headline reversal. It would not invalidate the method’s more controlled results involving known distilled students.

The second signal is any enforcement action supported by detailed evidence. U.S. officials have discussed investigations, sanctions, and trade restrictions against Chinese developers accused of covert extraction.

A credible action should identify the prohibited conduct, scale, access route, and connection to a resulting model. Broad assertions about benchmark quality will not meet that standard.

Provider records could supply the strongest evidence. Coordinated payments, shared infrastructure, repeated capability-specific prompts, and deliberate evasion would support an adversarial-distillation case.

Behavioral analysis could then connect that collection effort to a released model. The combination would be stronger than either form of evidence alone.

The third signal is whether OpenAI, DeepSeek, Moonshot, Anthropic, and Alibaba disclose more about synthetic training data. Detailed provenance would turn today’s speculative lineage maps into testable claims.

Developers do not need to publish every private dataset. They can still identify major external teacher families, authorized output sources, and the stages where synthetic data entered training.

OpenAI’s response deserves particular attention because the paper names GPT-OSS. A technical explanation of its reference models and external synthetic data could clarify the ambiguous DeepSeek and QwQ signal.

DeepSeek can respond in the same way. Greater detail about R1’s post-training sources would help test whether the detected o1-style behavior reflects direct distillation or a more indirect lineage.

Silence will not prove misconduct. It will keep policymakers, buyers, and researchers dependent on incomplete behavioral and infrastructure clues.

This technology news dispute is therefore moving toward an evidence contest. One side has provider logs and security claims, while the other points to technical innovation and insufficient public proof.

The new study does not declare a winner. It shows that model ancestry can leave measurable traces, including traces that complicate the preferred story of either country.

Readers should watch for replicated audits, documented access violations, and specific provenance disclosures. Those signals will reveal whether model forensics can mature before political claims harden into permanent policy.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page