top of page

Huawei Intel Shows Why Nvidia Still Dominates Chinese AI Training

Huawei intel from major Chinese AI labs points to a stubborn conflict: Nvidia chips reportedly remain their normal choice for training large language models.

The preference persists despite years of export restrictions, domestic sourcing pressure, and rapid improvements in Huawei's Ascend processors. The immediate obstacle is not only computing performance. It is the work required to move production training code from Nvidia's CUDA platform to Huawei's CANN software.

That distinction changes the meaning of China's AI chip race. Huawei can win hardware orders and support more inference workloads while Nvidia remains deeply embedded in model development. The contest is therefore between CUDA-based training and a domestic CANN alternative, not simply between two processor specifications.

Chinese AI Labs Still Build Their Largest Models Around Nvidia

The latest reporting suggests that Nvidia remains the default training platform even as Huawei gains ground elsewhere in China's AI infrastructure.

According to the original account, sources at major Chinese large language model developers said Nvidia chips remain the norm for advanced training. Moving established projects to Huawei hardware would require extensive rewriting for CANN.

CUDA, short for Compute Unified Device Architecture, is Nvidia's programming platform for running parallel workloads on its processors. CANN, or Compute Architecture for Neural Networks, is Huawei's corresponding software stack for Ascend processors.

Both platforms connect AI frameworks with accelerator hardware. However, they do not provide interchangeable execution environments for every kernel, library, communication operation, or debugging workflow.

That matters because frontier model training is not a single application copied onto a different server. It combines thousands of software components developed, tested, and optimized over several years.

A training team might use PyTorch at the top of its stack. Beneath that familiar framework sit custom CUDA kernels, collective communication libraries, memory-management routines, profiling tools, and hardware-specific optimizations.

Moving that workload to CANN means checking each layer. Unsupported operations must be replaced, rewritten, or routed through compatibility tools. Engineers then need to verify numerical behavior, performance, memory consumption, and stability at scale.

The reported preference does not mean Chinese laboratories reject Huawei. It indicates that they separate training decisions from other hardware decisions.

Training creates a model by processing enormous datasets across large accelerator clusters. Inference uses the finished model to answer requests after training concludes.

Inference workloads are often easier to port because they are narrower and more predictable. Teams can optimize a fixed model without repeatedly changing its architecture during research.

Training is less forgiving. A failure during a long distributed run can waste substantial computing time, while a subtle numerical error can damage the resulting model.

Chinese laboratories therefore have a practical reason to retain a proven platform for their most expensive experiments. Engineers already know CUDA's failure modes, performance tools, and optimization patterns.

The decision represents operational risk management more than brand loyalty. A laboratory facing a model deadline will usually favor the environment most likely to complete the run.

That preference also explains why hardware sales alone provide an incomplete measure of the contest. Huawei can capture accelerator demand without immediately displacing Nvidia from the hardest development workflows.

The Chinese chip market already illustrates that split. Bernstein estimated Nvidia and Huawei each held roughly 40 percent of China's AI chip market in 2025.

Bernstein expected Huawei's share to approach 50 percent during 2026, while Nvidia's share could fall near 8 percent. Those estimates describe overall market movement, not necessarily frontier training adoption.

The apparent contradiction is central to the story. Nvidia can lose broad market share while retaining an outsized role in the workloads that create leading models.

Why Huawei Intel Keeps Pointing Back to CUDA

Huawei intel about migration friction reveals that Nvidia's strongest defense is accumulated software, not one generation of faster silicon.

CUDA has existed since 2006. During that period, Nvidia built libraries for linear algebra, neural networks, distributed communication, data processing, and performance analysis.

Developers also created their own CUDA extensions. Research repositories, model implementations, and optimization guides commonly assume access to Nvidia hardware.

This accumulated code forms a network effect. More CUDA users produce more tested software, which makes CUDA more useful to the next team adopting it.

Huawei faces a different starting point. CANN must support Ascend hardware while matching the expectations created by years of CUDA development.

The challenge involves more than translating function names. A kernel designed around an Nvidia processor's memory hierarchy may behave differently on an Ascend neural processing unit.

Collective communication presents another obstacle. Large models divide parameters and data across hundreds or thousands of accelerators, which exchange information continuously during training.

Small communication delays compound across a cluster. A port that runs correctly on one processor can become inefficient or unstable when expanded across many machines.

Engineers must also replace monitoring and debugging practices. A profiler built around CUDA cannot automatically expose every CANN bottleneck with the same detail or familiar interface.

A 2025 AI stack assessment from MERICS described CUDA portability as a major advantage for Nvidia. It found that switching established models to non-Nvidia hardware remained costly.

The report also cited concerns about CANN maturity, crashes, recovery, and compatibility between successive Ascend systems. Those findings predated Huawei's latest software and hardware releases, so they are not a current benchmark.

They remain useful because they identify the type of engineering debt Huawei must overcome. New processors do not automatically remove code migration, documentation, or reliability problems.

Huawei has responded directly. In August 2025, the company announced that key parts of CANN would become open source and invited universities, companies, and developers to contribute.

The CANN initiative targets one of CUDA's advantages: a large community that identifies bugs and expands hardware support.

Opening code can accelerate development and improve transparency. It cannot instantly reproduce the library coverage, developer experience, and institutional knowledge surrounding CUDA.

The lag is especially important for custom kernels. Frontier laboratories increasingly write specialized operations to reduce memory use or improve training efficiency.

Those operations often encode assumptions about CUDA and Nvidia's architecture. Automated conversion may provide a starting point, but a successful build does not guarantee equivalent speed or stability.

Engineers still need to profile the result, examine numerical accuracy, and tune it for different hardware. That process competes directly with model research for scarce specialist time.

A laboratory must therefore compare two costs. One is continued dependence on restricted foreign hardware. The other is the delay and engineering effort required to establish a native domestic stack.

CUDA wins whenever the second cost appears greater than the first. CANN becomes more attractive as access risk grows or migration tools reduce that cost.

Huawei Ascend Is Advancing Faster in Inference Than Training

Huawei's most credible route around Nvidia begins with inference, where fixed models offer a more manageable target than experimental training runs.

Huawei has improved both its processors and the systems connecting them. Its strategy links large numbers of Ascend accelerators to compensate for limits affecting individual chips.

This system-level approach is important. Modern AI performance depends on memory, networking, scheduling, and software working together, not simply on a processor's advertised throughput.

Huawei can also optimize inference for widely deployed models. Once developers freeze a model's architecture, engineers can study its repeated operations and tune them for Ascend.

DeepSeek provides a visible example of this distinction. Its V4 release supports Huawei processors for at least part of its deployment, reducing exclusive dependence on American suppliers.

However, support for inference does not establish that the model was trained entirely on Huawei hardware. Public descriptions of hardware use often blur those two stages.

The separation matters for buyers. A provider can train a model once on Nvidia hardware and serve millions of requests through domestic accelerators afterward.

That arrangement reduces operating dependence without placing the most uncertain research run on a newer platform. It also gives Huawei sustained production workloads that can improve CANN.

Each deployment supplies engineers with bug reports, performance traces, and compatibility requirements. Those lessons can gradually strengthen the software needed for more demanding training.

Recent research shows both the progress and remaining complications. A July 2026 Ascend field study examined large mixture-of-experts and multimodal inference workloads on a 16-device Ascend 910 system.

A mixture-of-experts model activates selected groups of parameters for each input, reducing computation while increasing routing complexity. Multimodal models process combinations such as text and images.

The researchers focused on the engineering cost of serving those demanding workloads outside CUDA. Their work treats migration as an operational problem, rather than assuming hardware compatibility from theoretical performance.

Huawei's inference progress still creates pressure for Nvidia. Inference accounts for recurring demand after a model enters production, while training purchases can arrive in concentrated cycles.

A provider that handles inference on Ascend gains experience with Huawei's tools and cluster design. That experience lowers the barrier for later post-training or full training projects.

Post-training adjusts an existing model through fine-tuning, preference learning, or reinforcement learning. It often needs less compute than building the base model from the beginning.

This makes post-training a plausible bridge. Teams can move a bounded workload to Ascend before risking a full pretraining campaign.

Reports of large Ascend post-training clusters should therefore be taken seriously. Yet they should not be presented as proof that CANN has reached parity for every frontier training task.

A successful controlled workload tests only a specific model, cluster, and software version. Research laboratories continually change architectures, precision formats, parallelism strategies, and custom operations.

Nvidia's advantage lies partly in absorbing those changes without forcing teams to rebuild their environment. Huawei must show similar flexibility across several independent laboratories.

For now, the market is separating into layers. Huawei is becoming more competitive in domestic procurement, inference, and selected post-training projects.

Nvidia retains an advantage in the open-ended training work that creates the next generation of models. That is a narrower position than total market dominance, but it remains strategically valuable.

The Real Switching Cost Is Lost Research Time

Rewriting code is expensive, but the larger risk is slowing the experimentation cycle that determines whether an AI laboratory stays competitive.

A frontier model team does not run one final training job. It conducts smaller experiments, tests architecture changes, adjusts data mixtures, and measures scaling behavior.

Each experiment influences the next one. The speed of that loop can matter as much as access to a larger theoretical pool of computing power.

A migration interrupts the loop. Engineers who usually improve models must instead inspect operators, rebuild kernels, and diagnose unfamiliar cluster failures.

Teams can hire dedicated infrastructure specialists, but those experts remain scarce. They also need close contact with model researchers because performance problems often cross organizational boundaries.

The opportunity cost is difficult to measure. A migration might appear successful while quietly reducing the number of experiments completed before a release deadline.

That risk helps explain the reported resistance to abandoning CUDA. An AI laboratory does not evaluate processors like interchangeable office equipment.

The hardware determines which software works, how quickly failures are diagnosed, and how easily research code becomes a reliable distributed workload.

Procurement pressure can push laboratories toward domestic systems. It cannot erase the cost of missed experiments or failed runs.

The pressure is especially intense for Chinese laboratories seeking to match models from OpenAI, Anthropic, Google, Meta, and other well-funded developers.

Their competitors already operate large Nvidia clusters and can use the same CUDA-centered research ecosystem. A slower migration cycle would widen the development gap, even if it improved supply independence.

This creates an uncomfortable choice for Chinese AI companies. Nvidia hardware carries regulatory, import, and continuity risks. Huawei hardware carries software migration and execution risks.

Neither option offers certainty. Export licenses can change, customs approvals can stall, and domestic procurement policies can tighten.

At the same time, CANN releases can introduce new capabilities or compatibility changes. A laboratory must decide whether to absorb migration work now or remain exposed to future access restrictions.

Teams may answer by supporting two stacks. They can retain CUDA for critical training while moving inference and selected workloads to Ascend.

A dual-stack strategy provides flexibility, but it is not free. Engineers must maintain separate kernels, testing processes, container images, and performance baselines.

Model changes then require validation on both systems. Documentation and incident response also become more complicated.

Alibaba has explored mixed and alternative hardware approaches, while other Chinese chipmakers promote compatibility layers. These efforts attack the switching problem from different directions.

A compatibility layer lets CUDA-oriented code run on another processor with fewer source changes. However, it must track Nvidia's updates and translate behavior efficiently.

Huawei's native CANN strategy offers greater control over Ascend optimization. It demands more adaptation from teams whose systems were built around CUDA.

Neither path guarantees an immediate replacement. Compatibility can reduce rewriting while sacrificing performance or coverage, and native migration can improve optimization while increasing engineering work.

Organizations managing complex technical migrations need searchable records of experiments, failures, and decisions. A structured engineering knowledge base can preserve that context across infrastructure and research teams.

Documentation does not remove platform differences. It does reduce repeated investigations when teams revisit the same kernels, configurations, or numerical discrepancies.

The decisive metric is therefore not simply chips shipped. It is the time required to reproduce a working training pipeline and recover its previous development velocity.

What the Huawei Intel Narrative Still Cannot Prove

The reported CUDA preference is credible, but anonymous sourcing and limited disclosure prevent firm conclusions about every Chinese laboratory or workload.

Major AI companies rarely publish complete inventories of their training hardware. They also avoid exposing detailed cluster configurations, procurement arrangements, and infrastructure weaknesses.

That secrecy has commercial and political reasons. Hardware access can reveal model capacity, operating constraints, or potential exposure to export-control scrutiny.

The latest Huawei intel should therefore be read as evidence of a broad preference, not a complete census. Different laboratories may use different combinations of owned chips, cloud resources, and overseas infrastructure.

Definitions also matter. A company can say that a model supports Ascend without saying where pretraining occurred.

It can use Huawei chips for inference, post-training, evaluation, or part of a mixed workflow. None of those uses proves that the entire base model was trained through CANN.

Conversely, training on Nvidia does not mean Huawei has failed. It may reflect hardware purchased earlier, a temporary deadline, or a deliberate transition plan.

Public market-share estimates create another source of confusion. They combine different chip classes, customers, and applications.

A processor purchased for government inference infrastructure does not displace an Nvidia accelerator inside a private frontier-model training cluster. Both still count as AI chip demand.

Reported shipment figures also say little about utilization. A mature cluster with better software can deliver more useful work than a larger installation suffering from outages or poor scaling.

Huawei's progress must therefore be judged through reproducible workload evidence. Useful proof would include training completion rates, cluster uptime, scaling efficiency, and developer migration time.

Hardware benchmarks alone remain insufficient. A processor can perform well on isolated operations while struggling with an evolving model spread across a large cluster.

There is also a risk of freezing the comparison in the past. CANN has continued to develop, and open-source participation can improve its tooling faster than historical assessments imply.

Research into automated kernel generation may also reduce migration costs. The CANN Bench project evaluates AI-generated operator code against real Ascend hardware and algorithmic limits.

If AI systems can reliably translate and optimize accelerator code, Nvidia's software moat becomes less absolute. The key word is reliably.

Generated kernels must still pass correctness tests, handle unusual shapes, and remain stable across software versions. They also need performance close to carefully tuned native implementations.

Automated tools could reduce the first stage of rewriting without eliminating validation. That alone would still change the economics of migration.

Another uncertainty concerns Nvidia's future access to China. Beijing's policy can favor domestic hardware while tolerating selected imports for training bottlenecks.

The United States can also modify which products Nvidia may export. These decisions change the urgency of CANN adoption independently of Huawei's technical progress.

Nvidia faces its own strategic tension. Continued sales can preserve CUDA adoption, while restrictions encourage customers and governments to fund alternatives.

Jensen Huang has repeatedly argued that excluding American technology accelerates foreign competitors. His concern reflects the same software dynamics visible in Chinese laboratories.

Every CUDA installation can reinforce Nvidia's developer base. Every unavailable accelerator gives Huawei another chance to place Ascend hardware and improve CANN through production use.

The evidence supports a cautious conclusion. Nvidia still appears difficult to replace for leading training workloads, but its position depends on continued access and continued software superiority.

Three Signals Will Show Whether CANN Can Break CUDA's Training Hold

The next phase will be decided by verifiable training deployments, measured migration time, and sustained access to Nvidia hardware.

The first signal is a disclosed frontier-scale pretraining run completed primarily on Ascend processors. The disclosure should distinguish base-model training from inference and post-training.

A credible example would include the processor generation, cluster size, software version, training duration, and scaling behavior. Independent technical detail would matter more than a launch claim.

Such a result would strengthen the case that CANN can support rapidly changing research workloads. Repeated results from unrelated laboratories would carry even greater weight.

A single successful run would not establish universal parity. It would show that Huawei has crossed an important operational threshold for at least one demanding configuration.

The second signal is measurable reduction in CUDA-to-CANN migration time. Huawei and its partners need evidence that established projects can move without months of specialist work.

Useful indicators include broader PyTorch operator coverage, reliable kernel conversion, stronger profiling tools, and stable upgrades between CANN releases.

Developers will also watch recovery from distributed failures. A cluster that resumes a long training job safely can protect far more value than one posting a higher isolated benchmark.

Open-source activity can provide early evidence. More external contributors, faster issue resolution, and broader framework support would show that CANN is developing beyond a vendor-controlled toolchain.

The third signal is the actual availability of Nvidia accelerators inside China. Announced export permissions do not necessarily produce delivered, usable clusters.

The Associated Press reported that Nvidia had not generated H200 revenue in China by late June 2026, despite earlier discussion of potential access. Beijing's purchasing stance remained unclear.

If Nvidia deliveries remain blocked, Chinese laboratories will have stronger incentives to absorb migration costs. Huawei could gain the workloads needed to improve CANN through practice.

If deliveries resume at meaningful scale, laboratories can preserve CUDA-based training while adopting Ascend selectively. That outcome would weaken the case for an immediate full-stack transition.

The two suppliers therefore face different tests. Nvidia must keep its hardware accessible enough for CUDA's software advantage to matter.

Huawei must convert political and procurement support into a development environment that researchers trust with their most expensive training runs.

For developers, the practical lesson is to examine software dependencies before evaluating accelerator alternatives. Kernel coverage, communication libraries, observability, and failure recovery can outweigh headline performance.

Enterprise buyers should also ask which stage of an AI workload will run on each platform. Training, post-training, and inference create different migration risks.

For AI users, the eventual outcome will affect model availability, serving capacity, and the pace of new releases. It may also produce regional stacks optimized around different hardware.

The current Huawei intel does not show that China's domestic AI hardware strategy has stalled. It shows that hardware replacement and software replacement move at different speeds.

Huawei is gaining installations, inference experience, and a larger domestic role. Nvidia still benefits when research teams choose the platform that protects their development cycle.

The decisive question is no longer whether Ascend processors can run large models. It is whether CANN can let laboratories change those models quickly, repeatedly, and reliably.

Watch the next disclosed training run, the next major CANN release, and the next confirmed Nvidia delivery. Together, those signals will show whether CUDA remains China's default or becomes a temporary bridge.

Get started for free

A local first AI Assistant w/ Personal Knowledge Management

remio only supports Windows 10+ (x64) and M-Chip Macs currently.

​Add Search Bar in Your Brain

Just Ask remio

Remember Everything

Organize Nothing

bottom of page