top of page

NVIDIA Vera Rubin on OCI Expands Toward Multi-Gigawatt Scale, With CPUs Taking a Larger Role

2 hours ago
11 min read

NVIDIA and Oracle announced a planned multi-gigawatt expansion on October 27, alongside general availability of NVIDIA Vera Rubin on OCI. The announcement pairs new GPU capacity with standalone Vera CPUs for work that happens between model calls. Its significance extends beyond larger clusters: customers can expand those resources independently as their applications change.

OCI, short for Oracle Cloud Infrastructure, is pitching that flexibility to developers building agents, software systems that call models and execute tools. Those applications alternate between generating answers and performing ordinary computing tasks. Buying more model-serving capacity does not automatically make the surrounding work faster.

The central tension is between expanding installed computing capacity and keeping that capacity productive. Google Cloud already promotes coordinated CPU and accelerator infrastructure through Ironwood and Axion. Oracle’s announcement brings that same system-level competition into sharper focus, while giving NVIDIA’s CPU business a more visible place beside its GPUs.

NVIDIA Vera Rubin on OCI Combines Availability With an Expansion Plan

The immediate product launch and the planned infrastructure expansion represent different milestones.

In their joint Vera Rubin expansion, NVIDIA and Oracle distinguish current availability from future scale. Vera Rubin NVL72 systems and Vera CPUs are generally available on OCI. Expanding OCI Superclusters with those systems to multi-gigawatt scale remains a stated plan.

That distinction matters for readers interpreting the headline. General availability establishes a commercial offering. It does not mean the entire planned expansion is installed, energized, reserved, or serving customer workloads.

A gigawatt measures power, rather than completed computing work. Translating a power commitment into useful AI services requires equipment, networking, cooling, software, and customer deployment. The headline therefore describes the intended infrastructure footprint, without establishing a corresponding amount of delivered application output.

The rack itself provides a more concrete reference point. NVIDIA’s NVL72 specifications describe a configuration combining 72 Rubin GPUs and 36 Vera CPUs. A GPU, or graphics processing unit, handles the parallel calculations central to model training and inference, the process of generating model outputs.

Those components work together inside the rack, but the separate CPU offering addresses a different purchasing decision. Customers running tool execution or application services need computing capacity outside the tightly connected model-serving system. Oracle and NVIDIA say customers can scale their CPU and GPU resources independently.

The practical implication is flexibility in how customers assemble an application. A team does not necessarily need to expand every resource pool whenever one stage becomes congested. It can evaluate whether model generation, code execution, retrieval, or another step needs additional capacity.

That is an architectural option, rather than an automatic efficiency improvement. Applications still need software that directs work to appropriate resources and responds when demand changes. Independent scaling gives operators another control; it does not decide how they should use it.

For buyers, the announcement creates separate questions about availability and delivery. Which configurations can they obtain now? Where can they obtain them? What capacity can Oracle commit to over the life of their deployment?

Those questions also determine how much weight to put on the expansion plan. A large future footprint is useful context for long-term procurement. A specific allocation, supported configuration, and deployment window provide more immediate evidence for an engineering decision.

Agent Workloads Put Pressure on the Computing Between Model Calls

The announcement puts pressure on teams that measure AI capacity mainly through their GPU fleet.

A model response is only part of an agent’s job. After selecting an action, the application must execute it, inspect the result, and decide what happens next. Those stages introduce different computing requirements and different sources of delay.

Consider an illustrative coding agent assigned to repair a failing application. It retrieves project files, asks a model to propose a change, runs tests, and returns the results for another decision. The model and the test runner perform different work, even though the user experiences one continuous task.

Adding model-serving capacity helps when generation is the constraint. It does less when tests wait for an execution environment or spend time compiling dependencies. The relevant question becomes where the workflow waits, rather than which component has the most impressive specifications.

NVIDIA and Oracle explicitly identify executing tools, testing code, and retrieving data as CPU-intensive tasks supporting agents. A CPU, or central processing unit, runs general application instructions and manages much of this surrounding work. The companies position standalone Vera capacity as a way to support those stages separately.

Oracle’s Vera CPU deployment adds a scale claim: an initial deployment of 150,000 CPUs. Oracle also describes early customer access and says OpenAI is bringing Vera into production for agentic workloads. These are supplier and customer statements presented through Oracle’s publication.

The CPU count shows the scope Oracle assigns to the offering. It does not reveal how many processors a particular customer can reserve, how heavily they run, or how much application throughput they deliver. Those distinctions prevent deployment scale from becoming a substitute for operating evidence.

The immediate pressure falls on infrastructure planners and AI application teams. They need to understand the balance between model requests and the work those requests trigger. A procurement process centered on accelerator counts leaves that balance underexamined.

That does not mean every agent application needs a specialized CPU deployment. Some workflows spend most of their time waiting for external services. Others generate long model responses with relatively little tool execution. The appropriate resource mix depends on the application’s actual sequence of operations.

The same principle applies to knowledge workflows. An assistant searching an AI knowledge base must retrieve relevant material before producing a useful answer. Additional generation capacity cannot compensate for inaccessible documents, missing permissions, or slow retrieval.

For enterprise buyers, that connects infrastructure decisions to user experience. A service feels slow when a task stalls anywhere along its path. Customers rarely distinguish whether the delay came from the model, a tool, a database, or the software coordinating them.

The announcement therefore encourages a broader evaluation standard. Teams should ask how the infrastructure supports a completed task, including its intermediate steps. That is the pressure created by the launch: explaining application performance becomes as important as describing installed hardware.

Independent Scaling Addresses a Scheduling Problem

Separating CPU and GPU growth helps only when the application can use that separation effectively.

The mechanism behind NVIDIA Vera Rubin on OCI is straightforward at the architectural level. Keep tightly connected resources together where the model requires them. Provide separate computing capacity for surrounding tasks whose demand follows a different pattern.

NVIDIA’s Rubin platform architecture describes a system designed around coordinated computing, networking, and software. NVLink, NVIDIA’s high-speed connection between processors, supports communication within the model-computing system. That internal connection serves a different purpose from allocating a separate pool of tool-execution workers.

This distinction avoids a common misunderstanding. Independent scaling does not imply that every component inside an NVL72 rack changes independently. It describes how customers can grow distinct CPU and GPU resources across their application infrastructure.

Return to the coding-agent example. A burst of testing activity might require additional execution workers while model demand stays relatively stable. A different workload might generate more model requests without producing a matching increase in compilation or testing.

A fixed allocation risks leaving one resource pool underused while another develops a queue. Independent pools give operators a way to adjust that imbalance. The gain depends on whether their software recognizes the constraint and provisions useful capacity in time.

This is where scheduling, the assignment of work to available resources, becomes central. An application needs to decide where a tool runs, what data it receives, and when its result returns. Extra processors remain an incomplete answer if work cannot reach them efficiently.

Data placement complicates the decision. A worker needs access to files, dependencies, credentials, and relevant application state. Moving execution away from model-serving infrastructure creates another boundary that the software must manage.

That boundary is not inherently a drawback. It can support clearer allocation and isolation. However, a buyer should include its operational consequences when evaluating the benefit of separate resource pools.

A useful assessment follows a representative task from submission to completion. It records time spent generating model output, waiting for tools, running code, retrieving information, and retrying failed steps. The objective is to identify where additional capacity changes the result.

Successful completion also matters. Faster execution is less valuable if it produces more failed tasks or requires additional attempts. A meaningful comparison holds the task and acceptance criteria steady while examining the resources consumed.

These are evaluation principles, rather than published results from the announcement. They explain what evidence would support the companies’ efficiency argument. The launch establishes the available architecture; customer measurements must establish its value for particular applications.

The operational challenge grows when workloads change over time. A service that mostly answers questions today might perform more actions after a product update. Independent scaling offers room to respond, provided the application exposes the information operators need.

This makes the CPU offering more than an accessory to the GPU launch. It creates another place where NVIDIA and Oracle can participate in application infrastructure. Whether customers benefit depends on how closely that infrastructure matches the work they actually perform.

Cloud Rivals Are Competing Around the Complete AI Application

Oracle’s announcement belongs to a competition over coordinated systems, including the general computing that supports AI models.

Google Cloud provides a useful comparison because it explicitly connects accelerator and CPU development. Its Ironwood and Axion announcement discusses the coordination required by agent workflows. Ironwood is a TPU, Google’s specialized processor for machine learning, while Axion supports general computing.

The relevance is architectural. Google describes model acceleration alongside the application services, data preparation, and other work needed around it. Oracle and NVIDIA are now emphasizing a comparable need through Rubin systems and independently available Vera CPUs.

That does not establish equivalent products or performance. The platforms differ in their processors, software environments, service offerings, and deployment arrangements. Their announcements nevertheless point toward a shared buying question: how well does the complete system support the application?

For Oracle, standalone Vera CPUs broaden the discussion beyond access to NVIDIA accelerators. The company can pitch resources for model serving and the execution work surrounding it. That gives customers another configuration to evaluate when deciding where their agents should run.

For NVIDIA, the announcement extends the commercial importance of its CPU beyond its role inside an integrated rack. If customers adopt Vera for separate execution services, NVIDIA participates in a larger portion of their computing architecture.

That opportunity should not be confused with a universal migration case. Existing applications bring established dependencies and operational practices. Teams must weigh a new configuration against the work required to adopt and maintain it.

The competitive pressure also reaches conventional server deployments. Buyers considering Vera will want comparisons against the systems already running their tools and application services. Familiar infrastructure provides a practical baseline because teams understand its behavior under their own workloads.

The strongest comparison therefore starts with a customer’s existing application. It examines whether changing the execution platform improves task completion, responsiveness, resource consumption, or operational reliability. A component-level advantage addresses only part of that decision.

Software continuity matters as well. A company with an established model-serving environment will consider how a new configuration fits its deployment and support processes. Any hardware evaluation that ignores those processes understates the adoption work.

This is why the competitive story should remain separate from unsupported winner claims. Oracle’s launch expands its available options. Google’s CPU and accelerator strategy supplies relevant context. Neither announcement establishes which platform delivers the best outcome for every agent workload.

The broader shift is in what suppliers ask customers to evaluate. Accelerator specifications remain relevant, but the supporting execution environment increasingly enters the same conversation. Infrastructure providers must explain how their components cooperate throughout a task.

For readers tracking NVIDIA Vera Rubin on OCI, that is the most useful competitive frame. The headline concerns larger infrastructure commitments. The purchasing decision concerns whether a particular combination of services can support an application more effectively than its current arrangement.

Availability and Processor Counts Leave Important Questions Open

The announcement establishes products and plans without establishing universal gains in customer productivity.

The first uncertainty concerns the connection between general availability and practical access. A public launch does not specify every customer’s allocation, deployment location, or delivery schedule. Buyers need those details before translating an announcement into an implementation plan.

The second concerns the planned multi-gigawatt footprint. The announcement describes expansion, but the headline alone supplies no complete delivery schedule. Readers should distinguish intended scale from operating capacity as further information becomes available.

The third concerns application results. A large CPU deployment and a new GPU generation do not, by themselves, quantify how much faster an agent completes useful work. That requires a defined workload and a comparison against a clear baseline.

Oracle’s publication includes performance assertions, but those remain company claims unless supported by an independently assessable methodology. Buyers should examine the configuration, software, workload, and measurement boundary behind any advertised improvement.

The boundary is especially important for agents. Measuring a processor’s execution speed differs from measuring a complete task that includes model calls and external services. An improvement in one stage does not establish the same improvement across the entire workflow.

There is also a distinction between resource utilization and customer value. A busy processor might be handling productive work, retries, or unnecessary computation. High activity becomes meaningful only when it contributes to accepted results.

Conversely, some idle capacity serves an operational purpose. Applications may retain headroom for bursts, failures, or response-time requirements. An evaluation should distinguish avoidable waste from capacity held to meet a service commitment.

Independent scaling also transfers decisions to the application operator. Teams must determine when to add capacity, how much to retain, and how to respond when dependencies fail. Flexibility is valuable, but it introduces choices that require measurement and operational judgment.

Security adds another dimension. Agents executing generated code need controls over their environment and access. A sandbox, an isolated execution environment, limits what that code can reach, but its effectiveness depends on the surrounding implementation.

Customers should evaluate execution permissions, data handling, and failure containment alongside throughput. A faster worker with inappropriate access does not create a better production system. This matters especially when the agent retrieves proprietary information or acts through connected enterprise tools.

Migration presents a separate question. Moving an application to a different CPU environment requires checking software dependencies and deployment compatibility. The relevant effort depends on the application, so a broad launch announcement cannot settle it for every customer.

These uncertainties do not invalidate the launch. They identify the evidence needed to judge it accurately. The companies have announced an infrastructure option with a clear architectural rationale; the resulting operating benefits remain workload-dependent.

The cautious interpretation is therefore specific. Independent CPU and GPU resources give customers another way to address mismatched demand. Whether that option reduces waste or improves responsiveness must be established through application-level results.

Watch Capacity Access, Customer Measurements, and the Execution Software

The next evidence should connect the announced infrastructure to obtainable capacity and completed customer workloads.

The first signal is more specific access information. Over the coming months, customers should watch for supported configurations, deployment locations, allocation terms, and expansion milestones. Those details would clarify how the announced products translate into practical capacity.

More concrete delivery information would strengthen the case that the expansion supports near-term customer planning. Continued emphasis on aggregate scale, without corresponding access details, would leave that part of the story less resolved.

This signal matters separately for the GPU systems and standalone CPUs. Customers adopting one do not necessarily have the same requirements or timelines as customers adopting the other. Separate availability information would make the independent-scaling proposition easier to assess.

The second signal is customer measurement of complete workflows. Useful evidence would describe the application, its previous configuration, the changed resources, and the acceptance criteria. It would also explain what happened to task completion and resource consumption.

A coding-agent evaluation, for example, should include execution and testing rather than stopping at model generation. A retrieval application should include access to its underlying information. The comparison becomes more persuasive when it follows the user’s task across those boundaries.

Evidence that additional Vera capacity removes a measured execution constraint would support the launch’s central argument. Results showing that most delay occurs elsewhere would narrow the relevant use cases. Either outcome would help buyers make more informed decisions.

The third signal is production software that makes separate resource pools easier to operate. Watch how applications handle worker allocation, data access, execution state, and failures. Those capabilities determine whether independent resources function as a coordinated service.

This signal deserves attention because a hardware option does not automatically create a usable application architecture. Operators need enough visibility to understand where work waits and enough control to respond. Better coordination would strengthen the efficiency case without requiring every component to improve equally.

Together, these signals provide a grounded way to follow NVIDIA Vera Rubin on OCI. Capacity disclosures address delivery. Customer measurements address value. Execution software addresses the practical work of connecting the available components.

For developers, the announcement is a reason to examine where their own agent workflows spend time. For enterprise buyers, it is a reason to request evidence at the application level. For users, the relevant outcome remains a service that completes useful work reliably.

Before committing to a new infrastructure configuration, follow a representative task through the system and identify its actual constraint. Ask the provider to distinguish available capacity from planned expansion, and component claims from measured application results. Include execution, retrieval, failures, and recovery in the evaluation. Keep the workload and acceptance criteria consistent when comparing alternatives. That approach gives NVIDIA Vera Rubin on OCI a fair assessment while keeping the purchasing decision tied to the work customers need done. Which stage of your application would additional CPU or GPU capacity improve, and what measurement would show that improvement?

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page