top of page

Meta OCP Summit 2026 Puts Open Ethernet Against Proprietary AI Networks

12 hours ago
13 min read

Meta used OCP Summit 2026 to introduce its first liquid-cooled network rack and challenge specialized AI interconnects with an open Ethernet architecture.

The announcement extends from individual accelerator racks to clusters distributed across buildings, clouds, and regions. Its components include IcePack, IceCube, Flattened Planar Fabric, MetaRoCE, and a new switch-platform standard.

The individual products matter, but the larger argument matters more. Meta says one programmable Ethernet stack can support scale-up, scale-out, and scale-across networking without locking every layer to one supplier.

That position puts open Ethernet against specialized accelerator fabrics and proprietary platform interfaces. It also gives Broadcom, NVIDIA, Microsoft, Alibaba, Cisco, and cloud providers different roles inside the same infrastructure strategy.

Meta presented the designs at the OCP Global Summit in San Jose, held from October 12 through October 15, 2026. The summit program placed AI clusters, networking, liquid cooling, and open platform standards near the center of its agenda.

The technical claims are ambitious, but most performance evidence comes from Meta itself. The real test is whether other operators can reproduce the architecture across different accelerators, switches, and cloud environments.

Meta OCP Summit 2026 Unifies Three Network Domains

Meta is treating the AI network as one system that must operate inside racks, across clusters, and between regions.

The Meta network release organizes that system into three domains. Scale-up connects accelerators within a rack or tightly coupled pod. Scale-out connects many accelerator nodes inside a cluster. Scale-across joins capacity distributed among sites.

Those domains have traditionally imposed different requirements. Scale-up links prioritize extremely low latency and tightly synchronized communication. Scale-out fabrics must handle large collective operations across thousands of processors. Regional networks introduce distance, variable paths, and failure domains.

Meta’s response starts with IcePack, its first liquid-cooled networking rack. IcePack follows the OCP ORV3-HPRv1 rack standard and houses IceCube switch blades.

Each IceCube provides 102.4 terabits per second of switching capacity. It exposes 128 non-blocking 800-gigabit connections and doubles the bandwidth of Meta’s earlier 51.2T platforms.

Meta designed two IceCube variants around different switch chips. One uses Broadcom Tomahawk6C, while the other uses NVIDIA Spectrum-6. Both run Meta’s open-source FBOSS network operating system through the OCP Switch Abstraction Interface.

That dual-silicon design supports Meta’s broader argument. An open operational layer should let infrastructure teams qualify more than one hardware path without rebuilding their entire control environment.

Liquid cooling is not a cosmetic addition. Higher switch bandwidth increases power and thermal density, while AI racks already concentrate accelerators and supporting equipment into limited space.

Moving the networking layer into a liquid-cooled design helps Meta place 102.4T switches beside next-generation compute systems. It also reduces dependence on increasingly difficult air-cooling configurations.

IceCube only addresses one part of the network. Meta’s Flattened Planar Fabric, or FPF, changes how GPUs attach to the scale-out fabric.

Each GPU connects through eight independent 100-gigabit links. Those links reach eight switches, with one connection assigned to each network plane.

A conventional design commonly sends traffic through a single uplink structure. FPF distributes the available paths across independent planes and moves packet placement closer to the network interface card.

The topology also removes one switching tier. Meta says FPF changes its previous three-tier Clos design into a two-tier Clos fabric, reducing hops, latency, and infrastructure requirements.

A Clos fabric provides multiple paths between endpoints through layers of switches. Removing a layer simplifies that path, but it transfers more responsibility to endpoint hardware and control software.

The network interface card sprays packets across all eight planes in hardware. The combined host and switch control plane can then steer traffic away from an impaired plane.

Meta developed the production implementation with NVIDIA and its Spectrum-X Multiplane technology. That collaboration complicates any simple narrative about Meta trying to remove NVIDIA from its infrastructure.

Instead, Meta is trying to separate participation from control. NVIDIA silicon can remain part of the system, while Meta maintains an open operating model across multiple suppliers.

The immediate change is therefore larger than a faster switch. Meta has published a coordinated architecture for cooling, switching, routing, transport, and regional aggregation.

Open Ethernet Now Reaches Inside the Accelerator Rack

The central contest is whether Ethernet can serve tightly coupled accelerators without surrendering performance to specialized scale-up networks.

Scale-up networking has been the hardest part of the stack for Ethernet to enter. Communication inside an accelerator rack demands low latency, predictable delivery, and substantial bandwidth between processors.

Specialized interconnects gained ground because those requirements differ from ordinary data-center traffic. A training job cannot tolerate unpredictable pauses when hundreds of accelerators exchange partial results.

Meta is answering with Tahan, an Ethernet-based scale-up switch built for its MTIA 300 training accelerators. Tahan uses Broadcom’s 51.2-Tbps Tomahawk 5 switch chip.

The platform offers 64 ports operating at 800 gigabits per second. Meta assigns half of that capacity to accelerator connectivity through the backplane.

Four Tahan switches connect 16 accelerators in a non-blocking topology. Each accelerator receives 6.4 terabits per second of scale-up bandwidth, according to Meta.

Tahan also reuses the lossless RoCE transport configuration found in Meta’s scale-out network. RoCE carries remote direct memory access over Ethernet, allowing systems to move data without ordinary host-processing overhead.

Meta configures that environment with routed IPv6, priority flow control, and quality-of-service policies tuned for AI traffic. FBOSS operates the scale-up and scale-out switches.

This reuse is the mechanism behind Meta’s open-Ethernet thesis. A common operational stack can reduce the number of isolated networking systems that engineers must deploy and troubleshoot.

Meta is already shipping Tahan, while its next design is more ambitious. The company previewed a 216-port switch blade using 400-gigabit connections and Broadcom Tomahawk6C silicon.

Eight of those blades are intended to connect 72 accelerators inside one rack. The design would use the same 102.4T silicon generation found in IceCube.

A future version is planned around Ethernet for Scale-Up Networking, or ESUN. ESUN is an OCP effort defining fabric requirements for accelerator-scale Ethernet.

The distinction between a shipping product and a planned standard matters. Tahan exists today, but its current implementation is not yet the final ESUN-based architecture Meta describes.

ESUN 1.0 defines what the fabric must deliver while leaving accelerator implementation choices open. Its scope includes framing, error handling, and alignment with work from IEEE and the Ultra Ethernet Consortium.

Meta says ESUN 1.1 is approaching completion. Planned additions include switch profiles and reduced inter-packet gaps, which target lower latency inside scale-up fabrics.

The participating group includes AMD, Arista, Arm, Broadcom, Cisco, HPE, Marvell, Microsoft, and NVIDIA. That membership shows broad interest, but participation alone does not guarantee compatible products.

Ethernet’s advantage is not that every component becomes interchangeable immediately. Its advantage is a shared framework that operators, chip suppliers, and system vendors can implement without one accelerator company controlling the entire stack.

Specialized fabrics still hold important strengths. They benefit from close integration among processors, switches, software libraries, and collective communication algorithms.

Meta must therefore prove more than raw link capacity. It needs stable tail latency, predictable failure recovery, and sustained application performance under congestion.

If Ethernet meets those requirements, infrastructure buyers gain more negotiating leverage. They can combine accelerator, switch, and network software choices without accepting one vertically integrated package.

If it falls short, operators will still use Ethernet outside the rack while preserving specialized fabrics for the most demanding internal connections.

Flattened Planar Fabric Moves Intelligence to the Edge

FPF trades a simpler physical hierarchy for greater coordination among network interfaces, hosts, switches, and control software.

The flattened design reduces the network from three switching tiers to two. Fewer tiers can lower latency and remove equipment, but the remaining system must use its multiple paths effectively.

FPF starts load balancing at the network interface card. The NIC distributes individual packets across eight independent planes instead of waiting for switches to divide larger traffic flows.

Packet-level distribution can use available links more evenly. It can also create out-of-order delivery, because packets taking separate paths do not necessarily arrive in sequence.

That behavior explains why transport design is central to the architecture. A conventional transport may interpret reordered packets as evidence of loss, triggering unnecessary retransmissions or congestion responses.

MetaRoCE is Meta’s answer. It is an RDMA transport designed for collective AI communication over large Ethernet fabrics.

The protocol is multipath, receiver-driven, and tolerant of out-of-order arrival, according to Meta’s technical presentation. It treats packet loss as an expected network condition rather than assuming a perfectly lossless fabric.

Receiver-driven control means the destination helps determine when and how senders transmit data. That model gives the receiving system more influence over congestion and available capacity.

Meta says MetaRoCE supplies the reliability and congestion-control behavior required by distributed training. The company is releasing implementations so other infrastructure teams can examine and extend the design.

An earlier MetaRoCE presentation described implementations on AMD programmable network interface cards. It also covered multiplane topologies, tail latency, and long-distance RDMA.

Open code improves inspectability, but it does not automatically create interoperability. Broad adoption requires NIC support, compliance testing, stable specifications, and operational tools from multiple vendors.

That is why FPF and MetaRoCE should be evaluated together. FPF creates the multipath environment, while MetaRoCE attempts to make that environment usable for synchronized AI workloads.

The host also becomes part of the failure-control system. If a plane fails, the host can steer traffic toward the remaining planes instead of waiting for the network alone.

This design can limit the effect of an isolated switch or link problem. It also creates more state that operators must observe across endpoints and network devices.

Meta says FPF performs well under varied failure and maintenance conditions. However, the public announcement does not provide a complete independent benchmark set for those scenarios.

The architecture also requires hardware that can distribute packets at line rate. Operators cannot assume that every existing NIC can reproduce Meta’s implementation.

Cloud deployment introduces another complication. Providers use different topologies, traffic classes, congestion settings, switches, and RDMA transports.

Some clouds still rely on InfiniBand for specialized workloads. Others offer Ethernet-based systems that behave differently from Meta’s owned data centers.

Meta says its cloud partners run common point-to-point and collective benchmarks before capacity enters service. Those tests range from tens of GPUs to more than 1,000 GPUs.

The company also maps provider-specific traffic classes and congestion settings onto its own RDMA requirements. This process aims to make heterogeneous infrastructure behave consistently enough for production workloads.

That qualification work exposes an important limit to openness. A system can use open components while still demanding extensive integration and testing from a large engineering organization.

Meta summarizes the issue through standardization. Heterogeneous equipment is manageable, but every difference in transport, telemetry, and congestion behavior adds operating work.

Smaller operators may benefit from the resulting specifications and software. They are unlikely to reproduce Meta’s full validation apparatus immediately.

The competitive pressure therefore falls on vendors as much as cloud customers. Switch, NIC, and accelerator suppliers must show that their products fit a common operational model.

Scale-Across Networking Turns Distance Into a Scheduling Problem

Meta’s regional architecture treats geography as part of the training system, not merely a connection between separate data centers.

Meta says its planned AI capacity exceeds what one building or region can contain. Prometheus is designed around roughly one gigawatt in 2026, while Hyperion is intended to scale toward five gigawatts.

Those figures describe infrastructure plans, not a completed comparison of training performance. Still, they explain why Meta is connecting capacity across conventional buildings, outdoor structures, colocation facilities, and public clouds.

Backend aggregation, or BAG, is the scale-across layer. Meta describes it as a centralized Ethernet super-spine joining several spine-layer fabrics into one larger cluster.

The system operates at petabit scale. Inter-BAG capacity between two regions can reach tens of petabits per second, according to the company.

That bandwidth does not eliminate distance. Longer links require more time for packets and acknowledgments to travel, while lossless Ethernet requires enough buffer headroom for in-flight data.

A short local link and a link spanning tens of kilometers should not receive identical buffer allocations. Provisioning every connection for the worst case would waste scarce switch memory.

FBOSS instead measures installed cable length. It sends probe traffic through an uncongested queue, estimates round-trip distance, and allocates buffer headroom from that measurement.

This method makes physical distance an input to network configuration. It also depends on accurate measurements and conservative handling of changing conditions.

Path quality presents another problem. A route can remain available after losing part of its capacity, so a binary up-or-down signal is insufficient.

BAG uses eBGP link-bandwidth signaling to distribute traffic in proportion to available path capacity. Damping limits the routing churn caused by individual failures.

Training software adds a second control layer. Inter-fabric latency is several times greater than latency inside one fabric, according to Meta.

Collective communication libraries often choose algorithms without understanding geographic distance. A poor choice can force large volumes of synchronized traffic across slower regional paths.

Meta is addressing that problem with adaptive routing and workload scheduling. Routing reduces the network penalty, while scheduling tries to keep unnecessary collective traffic away from BAG.

The company also uses replicas to improve resilience. If one replica fails, the system excludes it while surviving replicas continue their synchronization work.

This is a meaningful shift in infrastructure design. Networking and job scheduling can no longer be optimized independently when one training job spans several sites.

Meta has also deployed Segment Routing over IPv6 for its regional backbone. SRv6 encodes routing instructions into IPv6 paths, supporting more deliberate traffic engineering.

The backbone runs FBOSS on shallow-buffer switches using Cisco Silicon One. Meta says it plans to qualify additional silicon families through OCP’s Switch Abstraction Interface.

This regional layer creates pressure for cloud providers. Meta wants leased capacity and public-cloud GPUs to resemble its owned infrastructure from an operational perspective.

Cloud partners cannot simply deliver isolated accelerator instances. They must expose predictable topology, congestion behavior, validation results, and telemetry at much larger scale.

The architecture also challenges conventional cluster boundaries. A cluster once described equipment inside one facility. BAG treats buildings, campuses, and nearby regions as components of one training system.

Longer distances remain a serious constraint. Meta discusses future jobs spanning tens, hundreds, or thousands of kilometers, but latency does not disappear through software.

The practical question is which workloads can tolerate those distances. Loosely coupled replicas may span regions more easily than tightly synchronized operations across every accelerator.

Meta’s announcement establishes the control mechanisms, not a universal result. Application structure will determine how much regional capacity behaves like one coherent machine.

Open Interfaces Do Not Remove Integration Risk

Meta’s strategy opens several layers, but its success still depends on difficult engineering across hardware, firmware, transport, and workload software.

The Open Switch Platform Architecture, or OSPA, targets a layer that remained fragmented after switch data planes became more portable.

The Switch Abstraction Interface lets network software control different switching chips. Yet the platform functions beneath that interface still require hardware-specific work.

Those functions include power sequencing, sensors, thermal management, hardware inventory, management connections, firmware updates, and diagnostics.

Meta says bringing up each platform has required months of duplicated engineering. OSPA defines common hardware and software interfaces intended to reduce that work.

Meta is co-leading the initiative with Microsoft and Alibaba. Version 1.0 has been submitted to the Open Compute Project.

This partnership gives OSPA credibility among large operators. It does not establish how quickly equipment suppliers will implement the specification or how consistently their implementations will behave.

Meta has also changed FBOSS so switch vendors can onboard their own platforms. The intended model lets several vendors develop compatible systems without waiting for Meta engineers.

Developers can inspect the FBOSS repository, which provides source code for Meta’s network operating system. Public code allows technical review, but production deployment requires more than access to a repository.

Hardware qualification, firmware compatibility, testing infrastructure, and incident response remain substantial investments. Vendors must also maintain their ports as the operating system and silicon generations change.

MetaRoCE faces similar adoption barriers. A protocol can be open while relying on programmable NIC features unavailable in many deployed systems.

Transport behavior must also remain predictable across switch buffers, routing policies, accelerator drivers, and collective libraries. A defect in any layer can appear as an application slowdown.

There is another strategic tension. Meta’s architecture depends on commercial silicon from Broadcom, NVIDIA, Cisco, and AMD while presenting an open operational model.

That arrangement is not contradictory, but it defines openness narrowly. Meta is opening interfaces, implementations, and reference designs rather than manufacturing every component itself.

Suppliers still control chip road maps, packaging, production capacity, and many low-level features. Operators gain alternatives only when several suppliers deliver equivalent implementations.

The collaboration with NVIDIA illustrates this balance. Meta worked with NVIDIA on FPF while positioning Ethernet as an option for network domains served by specialized technologies.

NVIDIA can benefit from selling Spectrum-X switches into open Ethernet environments. At the same time, broader Ethernet adoption can reduce dependence on a single vertically integrated accelerator network.

Broadcom gains a comparable opportunity through Tomahawk-based Tahan and IceCube designs. Cisco participates in the regional backbone through Silicon One.

Microsoft and Alibaba support OSPA because switch-platform standardization can lower duplicated engineering across large fleets. Their involvement also makes the initiative less specific to Meta.

Independent validation remains limited at launch. Meta calls its transport production-proven, but the announcement does not provide complete third-party results across competing NICs and switches.

Readers should therefore separate three claims. The designs exist, parts are running inside Meta, and open specifications can support wider adoption.

The first two claims have direct company evidence. The third depends on future implementations, compliance suites, supplier support, and deployments outside Meta.

Security and reliability also deserve attention. A common interface can reduce custom code, but shared implementations can concentrate defects across many platforms.

Operational simplicity is likewise not guaranteed. Supporting multiple vendors can improve leverage while increasing the number of firmware combinations that teams must qualify.

Open infrastructure succeeds when compatibility lowers total engineering work. It fails when nominally open components require extensive one-off tuning to operate together.

Meta’s release gives the industry a detailed direction. It does not yet resolve that economic test.

Three Signals Will Decide Meta’s Open Ethernet Bet

The next evidence must show repeatable interoperability, stable application performance, and adoption beyond Meta’s own fleet.

The first signal is the release and implementation of ESUN 1.1. The specification is expected to add switch profiles and shorter inter-packet gaps for low-latency scale-up traffic.

ESUN becomes more credible if accelerator and switch vendors ship compatible products against the same requirements. Compliance results would strengthen Meta’s argument more than additional membership announcements.

Delayed implementations or incompatible vendor interpretations would weaken it. They would suggest that Ethernet’s shared vocabulary still lacks a dependable scale-up product layer.

The second signal is external MetaRoCE deployment. Meta has announced open-source implementations, but adopters need working NIC support, compliance tools, and reproducible performance tests.

Watch for deployments that combine different NICs, switch chips, and accelerator systems. Results under congestion and partial failure will be more useful than ideal throughput demonstrations.

Tail latency deserves particular scrutiny. Average bandwidth can remain high while a small number of delayed transfers slows synchronized training.

Adoption by cloud providers would provide another meaningful test. Clouds operate heterogeneous fleets and expose the integration problems that a single owner can sometimes hide.

The third signal is the 72-accelerator rack built around 102.4T switching. Meta has previewed that platform, while Tahan’s smaller 16-accelerator topology is shipping now.

A production deployment would connect the open-standard road map to a denser operating system. It would also show whether cooling, transport, and collective software scale together.

Application results matter more than port counts. Useful evidence would compare training efficiency, failure recovery, power density, and operational workload under sustained production traffic.

The 2026 summit agenda shows how many groups are pursuing 800G, 1.6T, optical, liquid-cooled, and accelerator-network technologies simultaneously.

That breadth creates opportunity and fragmentation. Meta’s proposal tries to organize those components through shared Ethernet behavior and open platform interfaces.

For developers, the change affects where performance problems appear. Transport software, collective libraries, topology awareness, and failure handling now influence model throughput alongside accelerator code.

Infrastructure buyers should examine which layers are genuinely interchangeable. They should also ask who owns validation when components come from several suppliers.

Cloud customers should watch whether providers expose stronger topology and performance guarantees. Meta’s qualification model suggests that generic accelerator availability is no longer enough for large distributed jobs.

The Meta OCP Summit 2026 announcements make a coherent case for open Ethernet across the complete AI network. IcePack and IceCube address bandwidth and cooling. FPF and MetaRoCE address multipath transport. BAG and SRv6 address geography.

OSPA and FBOSS attempt to make the platform operable across suppliers. ESUN extends that effort into the most demanding scale-up domain.

The open approach wins only if other organizations can reproduce Meta’s results without Meta’s engineering scale. That is the question readers should carry into the next product cycle.

Watch the implementations, not just the specifications. If independent operators achieve predictable training performance across mixed hardware, Meta’s architecture will have changed the competitive basis of AI networking.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page