top of page

Samsung SK hynix PIM Chips Were Not a New 2026 Reveal, but the Race Has Moved On

Sep 25
12 min read

Samsung and SK hynix did not announce a joint next-generation memory-computing chip launch for October 2026, despite a recently surfaced headline suggesting otherwise. The verifiable event behind the wording dates to February 2022, when SK hynix prepared to present processing-in-memory technology at ISSCC.

That distinction matters because Samsung SK hynix PIM chips are now part of a much broader contest over AI infrastructure. Both companies have moved beyond isolated research announcements toward memory systems designed around inference, data movement, capacity, and energy use.

The original story was about processing-in-memory, or PIM, which places selected calculations inside memory instead of sending every operation to a separate processor. The current competition is larger. Samsung and SK hynix are now advancing different combinations of PIM, high-bandwidth memory, flash, packaging, and software.

This is not simply Samsung versus SK hynix over one experimental chip. The primary contest is between conventional GPU-centered systems and architectures that move storage or computation closer to the data.

The Reported Reveal Traces Back to ISSCC 2022

The available evidence points to an old conference announcement, not a newly scheduled October 2026 unveiling.

SK hynix announced GDDR6-AiM on February 16, 2022. The company described it as a processing-in-memory product that added computational functions to GDDR6 memory.

SK hynix said it would showcase the development at the 2022 International Solid-State Circuits Conference. ISSCC ran virtually from February 20 through February 24 that year, not during October 2026.

The company's announcement provides several clues matching the resurfaced headline. It involved a next-generation memory chip, computing inside memory, and an appearance at a major global semiconductor conference.

The timing language also matches a story written shortly before that conference. However, SK hynix said the presentation would happen “at the end of this month,” rather than during the following month.

According to the GDDR6-AiM announcement, the sample combined computing functions with GDDR6 operating at 16 gigabits per second. The company positioned it for machine learning, high-performance computing, and large-scale data processing.

SK hynix claimed that replacing conventional DRAM with GDDR6-AiM could make certain calculations 16 times faster. It also claimed an 80 percent reduction in power consumption by limiting movement between memory and processors.

Those were company-reported results tied to selected workloads. They did not establish comparable gains across every AI model, server, or production environment.

The same period included separate ISSCC presentations from both Korean memory manufacturers. The official ISSCC press kit listed SK hynix presenting an HBM3 design with 896 gigabytes per second of bandwidth.

Samsung presented a 16-gigabit GDDR6 design operating at 27 gigabits per second per pin. These presentations concerned advanced memory performance, although they were not a joint PIM product announcement.

Samsung's own PIM history began earlier. In February 2021, it introduced HBM-PIM, a version of high-bandwidth memory with programmable processing units integrated into each memory bank.

Samsung said the design targeted AI training, inference, and high-performance computing. Its paper was also selected for presentation at ISSCC.

The primary sources therefore support a more precise conclusion. Samsung and SK hynix were each advancing memory-centric computing around the 2021 and 2022 ISSCC cycle. They were not unveiling one shared product.

A headline that removes the original date can turn that historical development into apparent breaking news. Readers should treat relative phrases such as “next month” cautiously when an aggregator does not expose the publisher's full timestamp.

Why Processing in Memory Still Matters in 2026

PIM remains relevant because moving data now consumes time and energy that faster arithmetic alone cannot recover.

A conventional accelerator repeatedly transfers model weights, activations, and intermediate results between processors and memory. The processor can sit idle when the memory system cannot supply data quickly enough.

Engineers call this constraint the memory wall. Processor performance has improved faster than the ability to move large data sets efficiently through a system.

Processing in memory explained in practical terms is less complicated than its name suggests. Selected operations happen where data is stored, reducing trips across the interface connecting memory and the processor.

The idea does not replace a CPU or GPU with ordinary DRAM. Instead, it assigns suitable operations to specialized logic placed inside or near the memory subsystem.

That distinction is important. General-purpose processors remain better suited to control flow and varied calculations. Memory-side computing works best when a workload repeatedly performs predictable operations across large data sets.

AI inference creates many such workloads. A language model must continually retrieve parameters and manage temporary data while generating each token.

Longer prompts also increase pressure on the key-value cache, a collection of previously computed attention data reused during generation. Keeping that information available can reduce repeated calculation, but it demands substantial memory capacity and bandwidth.

Adding more GPU arithmetic does not automatically solve those problems. If data cannot reach the compute units quickly enough, additional processors can increase cost and power without delivering proportional performance.

PIM approaches try to reduce that imbalance. They can perform operations such as matrix calculations, searches, filtering, or data movement management closer to memory.

Samsung's original HBM-PIM design placed programmable computing units inside the banks of an HBM stack. HBM uses vertically connected DRAM dies to provide high bandwidth within a compact package.

Samsung reported that its prototype more than doubled system performance while cutting energy use by over 70 percent in selected applications. Those figures came from Samsung's testing and should not be treated as independent benchmarks.

SK hynix took a different initial route with GDDR6-AiM. GDDR memory is commonly associated with graphics, but its bandwidth also makes it useful for AI acceleration.

The company later combined AiM chips into an accelerator card called AiMX. This packaging offered a clearer path for testing PIM inside servers without redesigning an entire processor around the memory.

That is why Samsung SK hynix PIM chips still deserve attention four years after the original reports. AI infrastructure increasingly depends on more than peak GPU throughput.

Operators now evaluate how efficiently a platform serves models, handles long contexts, manages cache data, and scales within power limits. Memory architecture can affect every one of those measurements.

The result is a shift from faster memory as a component toward memory as part of the computing architecture. That change raises the strategic value of companies that previously supplied standardized chips behind the processor.

Samsung vs SK hynix AI Memory Is Now a Systems Contest

The competition has expanded from individual memory specifications to complete paths for moving, storing, and processing AI data.

Samsung has continued developing PIM while tying the technology to its broader memory and packaging portfolio. Its advantage is the ability to work across memory, logic manufacturing, and advanced packaging.

At Future of Memory and Storage 2026, Samsung displayed about 30 memory and storage technologies. The lineup included HBM4E, HBM5, LPDDR5X-PIM, and enterprise storage products.

LPDDR5X-PIM brings computing functions to low-power DRAM. That makes the approach relevant to edge systems and devices where energy consumption matters as much as raw throughput.

Samsung also presented zHBM, a proposed three-dimensional architecture that places high-bandwidth memory above a processor. The design aims to shorten data paths and address thermal limits through a dedicated cooling structure.

This approach differs from inserting calculation units into every memory product. It treats physical distance, packaging, and heat as parts of the same data-movement problem.

Samsung's 2026 memory portfolio therefore stretches from near-term HBM products to longer-term architectures. Some entries are shipping products, while others remain samples, demonstrations, or roadmap concepts.

SK hynix is building its own stack around HBM, PIM, high-bandwidth flash, and software. The company has labeled this direction a “full stack AI memory” strategy.

Its GDDR6-AiM chip remains the foundation for AiMX, the accelerator card designed for large language model workloads. SK hynix has demonstrated AiMX inside a server rather than limiting the technology to a standalone die.

In September 2026, the company showed an AiMX server running an interactive language-model demonstration. It also presented high-bandwidth flash and a software technique called SALT-KV.

High-bandwidth flash, or HBF, applies vertical interconnect technology to NAND flash. SK hynix positions it as a capacity-focused layer between fast HBM and conventional solid-state storage.

SALT-KV addresses the key-value cache created during language-model inference. The company says its software manages cached information according to its characteristics and potential for reuse.

SK hynix argues that these technologies serve different inference needs. PIM targets fast decoding, while HBF supplies more capacity for long-context workloads.

That portfolio illustrates the current Samsung vs SK hynix AI memory contest. The companies are not betting on one universal successor to ordinary DRAM.

Samsung is emphasizing integration across packaging, memory, and manufacturing. SK hynix is assembling specialized memory tiers and software around distinct AI serving patterns.

Micron and other memory suppliers add competitive pressure, while Nvidia, AMD, and custom accelerator designers influence which interfaces become commercially important. A technically impressive memory design still needs processor support and customer qualification.

Cloud operators also design more of their own silicon. Their choices can determine whether a memory technology becomes a broadly supported standard or remains tied to a narrow accelerator configuration.

This makes control over the software layer increasingly important. Developers need compilers, libraries, schedulers, and monitoring tools that understand where each operation should run.

Hardware that demands extensive application rewrites creates friction. Hardware that appears through familiar frameworks has a better chance of moving from a demonstration into production.

The Mechanism Is Reducing Data Movement

The strongest case for memory-side computing is not that memory becomes a GPU, but that fewer bytes must travel through expensive bottlenecks.

A modern AI server contains several different forms of memory and storage. Registers and caches sit closest to compute cores, followed by HBM or other attached memory.

System memory adds capacity farther from the accelerator. Solid-state drives hold much larger data sets but deliver greater latency.

Each transfer across these layers consumes energy. It also introduces delay and requires interfaces, controllers, and packaging resources.

PIM changes the workflow by placing limited compute units next to stored data. Those units can process suitable operations before sending smaller results back to the central processor.

Consider a recommendation system searching large embedding tables. A conventional design can move substantial amounts of data to a processor even when the final output is a small set of candidates.

Memory-side logic can filter or combine data near its source. The processor then receives fewer bytes and spends less time waiting for memory traffic.

Language-model inference presents another case. Generating text requires repeated access to model parameters and cached attention data.

PIM can accelerate selected repetitive calculations. High-capacity memory tiers can hold more of the model's working data near the server instead of repeatedly loading it from slower storage.

Neither method eliminates the GPU. The GPU still performs the model's central computations and coordinates execution.

The intended benefit is a more balanced system. Compute, bandwidth, capacity, and power should scale together rather than leaving one resource underused.

SK hynix made this argument at its September 2026 AI Infra Summit presentation. The company said conventional GPU-HBM architecture was becoming insufficient for workloads ranging from low-latency agents to long-context services.

Its AI memory showcase included PIM, HBF, AiMX, and SALT-KV. Visitors could examine hardware and interact with a language-model demo running on an AiMX-equipped server.

That demonstration matters more than another theoretical performance figure. It shows a path from a memory chip to a system that developers and customers can evaluate.

However, a conference demo does not prove production economics. It cannot establish reliability at fleet scale, software compatibility across models, or a lower total cost of ownership.

Samsung faces the same burden. Its PIM and three-dimensional memory concepts must fit processor roadmaps, packaging capacity, cooling systems, and customer software.

The mechanism also introduces tradeoffs. Logic added to memory consumes die area and power while increasing design complexity.

A PIM unit optimized for one class of calculation can become less useful when model architectures change. Fixed functions offer efficiency, but general programmability increases cost and overhead.

Memory manufacturers must choose where to place that boundary. Too little flexibility narrows the market, while too much flexibility recreates the complexity of a conventional processor.

These tensions explain why processing in memory explained through peak performance alone can mislead readers. Data movement is the problem, but useful deployment depends on the complete system.

Conference Claims Still Need Production Evidence

The unresolved question is not whether PIM works, but whether it works broadly enough to justify a new hardware and software layer.

Company announcements usually report results from workloads selected to match a new architecture. Those tests can establish technical potential without predicting production performance.

SK hynix's original claims of 16 times faster processing and 80 percent lower power applied to certain computations. They did not describe every workload or disclose a universal deployment result.

Samsung's earlier performance and energy claims were similarly tied to internal evaluations. They should be read as vendor measurements, not independent comparisons between full production systems.

Workload sensitivity presents the first risk. Memory-side computing offers the largest benefit when operations are repetitive, parallel, and limited by data movement.

Programs with irregular control flow can gain less. Some tasks can also become limited by networking, processor scheduling, or storage rather than memory bandwidth.

Software presents a second barrier. A PIM chip needs tools that decide which operations should execute inside memory and which should remain on the accelerator.

Those tools must work with changing models and frameworks. Otherwise, customers face engineering costs that can erase infrastructure savings.

Standards create a third challenge. AI processors, memory devices, and software stacks come from different suppliers with separate release cycles.

A proprietary implementation can move faster initially. A common programming model can reach more customers, but agreement across an industry takes time.

Manufacturing introduces another uncertainty. Combining logic and dense memory can complicate testing, yield management, packaging, and thermal design.

The memory industry has extensive experience producing reliable DRAM at scale. Adding computation can change the economics that make standardized memory attractive.

Samsung's manufacturing breadth gives it several integration options. Yet it must show that combining those capabilities produces reliable systems at acceptable yields.

SK hynix holds a strong position in high-bandwidth memory and has presented a wider range of AI memory solutions. It must turn that technical momentum into repeatable customer deployments beyond exhibitions.

This is where Samsung vs SK hynix AI memory becomes less straightforward than a specifications contest. Different architectures can succeed in different parts of the market.

Samsung may find stronger opportunities in tightly integrated packages or low-power devices. SK hynix may gain traction with accelerator cards, specialized inference systems, or layered memory architectures.

Both companies also depend on customers that control accelerator designs. Nvidia, AMD, cloud providers, and other chip developers can support, reshape, or bypass a memory supplier's preferred architecture.

The strongest evidence would therefore be a named production deployment with repeatable workload results. Customers would need to disclose performance, energy, utilization, and software costs under realistic conditions.

Without that evidence, readers should distinguish three stages of progress. A research paper establishes feasibility, a prototype demonstrates integration, and a qualified commercial product establishes customer readiness.

The resurfaced headline originally described the first two stages. It should not be interpreted as evidence that Samsung SK hynix PIM chips had already reached broad commercial adoption.

Three Signals Will Show Whether PIM Is Becoming a Market

Customer qualification, software support, and repeatable inference economics will determine whether memory-computing products move beyond specialized deployments.

The first signal is a named production platform adopting PIM or AiMX. A confirmed server or accelerator deployment would show that a customer accepted the hardware, software, and reliability tradeoffs.

The quality of that disclosure matters. A pilot, memorandum, or exhibition partnership does not carry the same weight as a shipping system available to customers.

A production adoption would strengthen the case that memory suppliers can capture more value from AI computation. Continued reliance on conventional HBM would weaken claims of an architectural transition.

The second signal is support inside mainstream AI software. Developers should watch for compiler integration, optimized kernels, open programming interfaces, and framework-level scheduling.

Software determines whether applications can use specialized hardware without being rewritten around one vendor. It also determines whether the system adapts as model structures change.

Broad tooling would strengthen the market for Samsung SK hynix PIM chips. Fragmented or closed software would limit them to customers able to maintain custom infrastructure.

The third signal is independently measured inference economics. Useful comparisons should include latency, throughput, energy, memory capacity, and utilization across several model types.

Long-context inference deserves particular attention because its cache requirements create direct pressure on memory capacity. Fast interactive agents provide another test because they emphasize low latency.

If PIM, HBF, or three-dimensional memory improves these measurements without excessive software work, memory-centric computing will become more compelling. If gains disappear outside selected demos, conventional accelerator designs will retain their advantage.

Readers should also separate PIM from the broader success of HBM. HBM has already become essential to high-performance AI accelerators, but that does not guarantee adoption of computation inside memory.

The more likely near-term outcome is a mixed hierarchy. GPUs will remain central, while specialized memory and storage layers handle workloads that benefit from greater bandwidth, capacity, or local processing.

Samsung and SK hynix are preparing for that outcome with different combinations of technologies. Their strategies suggest that future AI systems will not depend on one memory type.

The larger shift is conceptual. Memory suppliers increasingly describe their products as active parts of AI infrastructure rather than passive storage components.

That shift raises the stakes for processor companies. It also gives cloud operators more choices about where data is stored, moved, and processed.

Developers and enterprise buyers should watch deployments rather than conference labels. The important question is whether a new memory architecture improves a real workload after integration costs are counted.

The original report remains useful as a historical marker. It captured the moment when Korea's largest memory manufacturers publicly challenged the traditional separation between computation and storage.

Four years later, the idea has not vanished. It has expanded into competing roadmaps for PIM, HBM, high-bandwidth flash, advanced packaging, and memory-aware software.

The next meaningful announcement will not be another promise that memory can compute. It will be evidence that customers can deploy the technology repeatedly, measure its benefits, and support it across changing AI workloads.

For anyone evaluating AI infrastructure, that is the practical test to follow. Look for named systems, accessible software, and third-party results before treating the next conference demonstration as a market transition.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page