top of page

Google Gemini 3.8 Live Puts Extended Thinking Into the Voice AI Race

2 hours ago
14 min read

Google launched Gemini 3.8 Live on September 15, alongside an Extended Thinking model that reasons while a spoken conversation continues. The release targets a persistent voice-agent conflict: harder tasks demand more computation, but longer pauses make an assistant feel less natural.

The standard model favors responsive dialogue, visual context, and efficient deployment. Gemini 3.8 Live Extended Thinking handles multi-step work through background reasoning and asynchronous tools. It can acknowledge a request, keep the interaction active, and report progress before delivering a final answer.

That design puts Google into a sharper contest with OpenAI and other providers building native speech-to-speech systems. The contest is no longer limited to voice quality. It now concerns whether an assistant can act, reason, and maintain conversational rhythm at the same time.

Gemini 3.8 Live Splits Voice AI Into Two Operating Modes

Google is treating fast conversation and deeper voice reasoning as separate product requirements, not one adjustable setting.

The company introduced two models through its September 15 Gemini launch. Gemini 3.8 Live is the default choice for low-latency dialogue, direct requests, and tools that return quickly.

Gemini 3.8 Live Extended Thinking targets requests that require planning, parallel tool calls, or several dependent decisions. Google describes both as native audio models, meaning they process and generate audio within the model rather than relying entirely on separate transcription and speech systems.

This separation reflects a difficult design choice. A voice assistant must respond quickly enough to preserve conversational flow. However, a model answering immediately can lack the time needed to examine evidence, compare options, or coordinate external systems.

The standard model uses interleaved reasoning within a fixed latency profile. Developers cannot set its thinking level. This constraint makes its behavior more predictable for applications where every pause affects the user experience.

Extended Thinking exposes low, medium, and high reasoning levels. It can spend more computation on a problem while keeping the session active through spoken status updates. That approach gives developers more control, but it also adds new application states to manage.

Both models accept text, images, audio, and video. They return text or audio, support function calling, and operate through Google’s Live API. The standard model has an input limit of 131,072 tokens and an output limit of 65,536 tokens, according to the model documentation.

Google says the standard model can detect and transition among 97 supported languages during a conversation. It can also process visual information in near real time. A user might point a camera at equipment, software, or a document while asking spoken questions.

The company demonstrated that combination through employee onboarding, visual chess play, and live troubleshooting. Other examples included generating React components from sketches and voice feedback, coordinating bookings, and assembling business materials through speech.

These demonstrations matter because they move the release beyond a better talking chatbot. The models are positioned as interfaces for work that involves perception, decisions, tools, and changing context.

Gemini 3.8 Live is rolling out through the Gemini API, Google AI Studio, and Search Live. Enterprise access begins through a private preview of the Gemini Enterprise Agent Platform.

Extended Thinking is also available through the API and AI Studio. Google is bringing it to Gemini Live and selected Workspace experiences in Docs, Gmail, and Keep. Some enterprise and customer-experience deployments remain in preview or are listed as coming soon.

That uneven availability creates an important distinction. Developers can begin evaluating the underlying models immediately, but broader production access depends on the product and customer category.

Google has therefore launched both a model family and a deployment strategy. The standard version seeks scale, while Extended Thinking tests whether deeper agent behavior can remain comfortable in a live conversation.

Gemini Live Extended Thinking Makes Waiting Part of the Conversation

The central technical change is not hidden reasoning alone. It is a new interaction lifecycle for work that continues after the model starts speaking.

A conventional voice assistant usually follows a simple sequence. The user talks, the model responds, and the application marks the turn complete. An external tool can interrupt that flow because the assistant must wait for the tool’s result.

Extended Thinking replaces that single response with a longer interaction. The model can confirm the request, begin reasoning, call tools, narrate progress, and then deliver its conclusion.

Google’s Live thinking guide calls these interim messages conversational fillers. They can be useful statements such as “Checking flight options now,” rather than empty hesitation sounds.

The distinction matters for both users and developers. The model has not finished merely because it has stopped speaking once. It can produce several utterances while one request remains active.

Google added an interaction status to represent that process. An IN_PROGRESS status means the model is still reasoning or waiting for a tool. An IDLE status tells the client that the complete interaction has ended.

Applications using the standard model can continue treating turnComplete as the end of a user turn. Extended Thinking clients must follow the broader interaction state instead. Otherwise, an interface might reopen its microphone or accept a new command too early.

Tool execution also changes. Extended Thinking requires functions to use non-blocking behavior, meaning the application runs them asynchronously. Synchronous tools return an error because they would freeze the interaction.

This mechanism supports a travel assistant that searches flights and hotels at the same time. It could acknowledge the request, explain which options it is comparing, and later present a combined recommendation.

A technical support agent could inspect logs, check configuration details, and compare error codes while telling the user what it is examining. A tutor could verify a formula before explaining where a calculation went wrong.

Those examples reveal the real promise of Gemini Live Extended Thinking. The model is designed to mask operational latency without pretending that the work has already finished.

That difference is easy to underestimate. Silence creates uncertainty in a voice interface. Users cannot see a loading spinner unless the product supplies one, and they may not know whether the connection failed.

Spoken progress can preserve trust during a long task. However, it only works when updates correspond to real activity. Repeated or inaccurate narration would feel like delay disguised as conversation.

Developers must therefore coordinate the model’s speech with application state. They need clear policies for interruptions, duplicate commands, canceled tools, partial results, and failed requests.

The interface must also decide what happens when a user speaks during background reasoning. Some interruptions should stop the task. Others should modify it, such as adding a preference while a booking search continues.

That complexity makes Extended Thinking more than a model replacement. It changes the event model of the application. Teams migrating from Gemini 3.1 Flash Live must update how their clients determine when an interaction has actually ended.

The standard model offers a simpler migration. Developers update the model string and remove unsupported thinking configuration. Existing turn-completion behavior remains broadly familiar.

Extended Thinking requires deliberate client work. Teams must track interaction states, declare non-blocking functions, and handle multiple spoken responses within one request.

This split gives product teams a practical choice. A language-practice app may value rapid turn-taking more than extended planning. A service agent handling claims or bookings may accept additional complexity for stronger task completion.

Google is effectively arguing that voice systems need multiple latency budgets. Immediate dialogue needs one budget, while consequential multi-step work needs another. Extended Thinking tries to connect them without forcing users into silence.

Gemini 3.8 Live Raises the Pressure on OpenAI’s Realtime Stack

Google is challenging the assumption that developers must choose between natural speech and sustained agentic reasoning.

OpenAI remains a central reference point for native voice agents. Its Realtime API supports speech-to-speech interaction over WebRTC, WebSocket, and SIP, alongside text, image, and audio inputs.

OpenAI also provides server and semantic voice activity detection. These systems estimate when a speaker has finished, allowing the model to respond without a manual send action.

That stack addresses several foundations of live conversation. It supports interruptions, tool selection, audio configuration, and direct connections for calling applications. Its current model catalog also includes realtime models with reasoning and tool use.

Google’s new challenge focuses on how long-running work appears inside the conversation. Extended Thinking formalizes background reasoning, interim speech, asynchronous tools, and interaction-level status within one documented lifecycle.

This is a narrower distinction than saying one company has reasoning and the other does not. Both ecosystems support increasingly capable realtime agents. The meaningful question is how predictably developers can orchestrate those capabilities.

For Google, integration breadth strengthens the case. The models can appear in Search, Workspace, the Gemini app, and enterprise agent products. The same underlying behavior can reach consumers, employees, and third-party developers.

OpenAI brings its own advantages. Its realtime platform supports WebRTC and SIP, which matter for browser experiences and telephony. Its audio stack also offers detailed controls for turn detection, noise reduction, transcription, and voice behavior.

The contest therefore turns on complete workflows, not a single benchmark. A customer-service deployment needs reliable audio transport, tool execution, observability, regional controls, and predictable failure handling.

Google’s distribution could reduce friction for organizations already using Workspace or Google Cloud. A spoken assistant in Gmail or Docs can operate near the information users already manage.

That proximity creates another concern. More capable voice agents may touch messages, documents, calendars, and business systems during one interaction. Permission boundaries become as important as model intelligence.

OpenAI and Google must both show that their realtime systems can follow authorization rules across complicated tool chains. A model that chooses the correct action but uses the wrong account remains unsafe.

The competitive pressure also extends beyond OpenAI. Artificial Analysis tracks native speech models from Google, OpenAI, xAI, Qwen, StepFun, and other providers. Several models lead individual measures of speed or conversational behavior.

That diversity weakens any simple two-company narrative. Still, Google and OpenAI carry unusual influence because they combine models, developer platforms, consumer products, and enterprise distribution.

Google’s decision to ship two endpoints also pressures competitors to clarify their own product boundaries. Developers need to know whether a realtime model prioritizes immediate speech, deep reasoning, or a configurable balance.

A single “voice model” label no longer provides enough information. Teams now need details about first-audio latency, interruption handling, function behavior, state management, and performance on multi-step tasks.

Google has made those tradeoffs relatively explicit. Standard Live favors direct interaction. Extended Thinking accepts more complexity to manage tasks that require planning and slower tools.

That framing may prove more important than any temporary leaderboard position. It gives developers a vocabulary for deciding when deeper reasoning belongs inside a conversation.

However, it also raises expectations. Once a model narrates progress, users will assume it knows what is happening. Incorrect status updates become a product failure, not merely awkward wording.

Competitors can answer by offering faster reasoning, clearer state events, easier telephony, or better interruption control. The next phase of voice AI will reward the provider that combines these pieces reliably.

Google’s release makes that competition visible. Realtime intelligence is shifting from “Can the model talk naturally?” to “Can it finish useful work without losing the conversation?”

What the Gemini 3.8 Live Benchmarks Do Not Settle

Early scores support Google’s positioning, but controlled benchmarks cannot prove that a voice agent will remain reliable inside a production workflow.

Google says Extended Thinking earned an overall score of 82.6 on Artificial Analysis’ Speech to Speech Quality Index. The model also recorded 68.6 percent on the group’s τ-Voice agentic task measure.

It scored 97.7 percent on Big Bench Audio, a reasoning benchmark delivered through audio. Google separately reports 35.1 percent on Sierra’s banking-oriented τ-Voice evaluation.

The independent speech leaderboard gives helpful context. It lists Extended Thinking with a stronger overall score than standard Gemini 3.8 Live, which receives 76.0.

The results also expose the intended tradeoff. Standard Gemini 3.8 Live scores 96.1 percent on conversational dynamics and shows a lower time to first audio than Extended Thinking.

Extended Thinking performs better on agentic task completion but takes longer to begin speaking. That is consistent with a model designed to spend more effort before and during complicated work.

No single score captures the whole experience. Big Bench Audio measures whether a model can answer reasoning questions delivered as speech. It does not represent every problem in a call center or workplace.

Full Duplex Bench examines behaviors such as pauses, interruptions, backchannels, and decisions about when to speak. Those behaviors matter because a correct answer can still arrive through an uncomfortable conversation.

τ-Voice focuses more directly on task completion. However, a benchmark environment cannot reproduce every authentication failure, slow vendor API, ambiguous user request, or corrupted business record.

The comparisons are also moving targets. Artificial Analysis updates its index as providers add models and revise endpoints. A leading position at launch should be treated as a current measurement, not a permanent ranking.

Google’s own demonstrations deserve the same caution. Turning a sketch into a React component is a useful illustration of multimodal reasoning. It is not evidence that every generated interface will meet production requirements.

A booking demonstration can show coordinated function calls. It cannot establish how the agent behaves when inventory changes, a payment fails, or two tools return contradictory information.

The same gap applies to the claim of production readiness. Google supplies infrastructure and model features that support production deployment. Each company still needs its own evaluations, monitoring, and escalation paths.

Security deserves particular scrutiny. A voice agent can mishear a name, accept an instruction from background audio, or call a tool with an unintended parameter. Additional reasoning does not automatically remove those risks.

Multilingual switching creates another test. Supporting 97 languages is valuable for global services, but language coverage does not guarantee equal accuracy across accents, domains, and noisy environments.

Developers should also distinguish between spoken progress and exposed reasoning. Extended Thinking gives users short status updates, not a guaranteed transcript of the model’s internal reasoning process.

That distinction is healthy. A fluent explanation can be incomplete or reconstructed after a decision. Product teams should validate actions through structured logs rather than treating spoken narration as an audit trail.

Google’s audio model card provides the official place to review intended use, safety evaluation, and known limitations. Those disclosures should inform deployment decisions alongside performance charts.

All generated audio from Google’s AI products receives SynthID watermarking, according to the company. The watermark is intended to make synthetic audio detectable without creating an obvious change for listeners.

Watermarking addresses provenance, but it does not solve authorization or factual accuracy. A detectable synthetic voice can still produce a wrong answer or take an unwanted action.

The strongest interpretation of the launch is therefore measured. Gemini 3.8 Live appears competitive on conversation, while Extended Thinking improves measured reasoning and task completion.

The unresolved question is consistency. Enterprises need to know whether those gains survive long sessions, mixed-language conversations, failing tools, and requests with financial or legal consequences.

The Enterprise Opportunity Depends on Workflow Design

Gemini 3.8 Live will create value only when organizations redesign the work around voice, permissions, and human review.

The obvious use case is customer service, but Google’s release reaches beyond call deflection. A voice agent can guide onboarding, inspect visual context, query business systems, and explain results during one session.

That combination fits frontline work where people cannot continuously type. A technician might show a damaged component, describe its symptoms, and request the correct procedure without leaving the equipment.

A warehouse employee could ask about an item while sharing camera input. An assistant might identify the product, check inventory, and explain the next handling step.

An employee could also use Docs Live or Gmail Live to discuss a draft, locate related messages, and organize follow-up work. The value comes from reducing interface switching, not from voice alone.

These scenarios require careful data boundaries. A model should not search every connected source simply because the user asked a broad question. Tools need narrow scopes and explicit authorization.

Organizations should treat each function call as an operational event. The application should record which tool ran, what permissions applied, and whether the result changed an external system.

High-impact actions need confirmation. Reading a calendar is different from canceling a meeting. Comparing flights is different from purchasing a ticket.

Spoken interfaces make confirmation design harder because users cannot scan a form before submitting it. The agent should restate critical names, dates, quantities, and destinations before acting.

Visual grounding introduces similar obligations. Camera input can help an assistant understand the immediate environment, but it may also capture private documents or bystanders.

Applications need clear recording indicators and retention policies. They should minimize what enters the model and avoid retaining unnecessary audio or video.

Teams must also decide when Extended Thinking is justified. Running deeper reasoning for every greeting or simple lookup would add delay and operational cost without improving the outcome.

A routing layer can send direct tasks to standard Gemini 3.8 Live. It can reserve Extended Thinking for requests involving multiple tools, conflicting evidence, or a meaningful decision.

That architecture mirrors how human support works. Simple questions receive immediate answers. Complex cases move into a longer process with investigation and status updates.

The difference is that users may not see the handoff. A well-designed system should communicate when a request has entered a deeper workflow and how the user can stop it.

Knowledge quality remains another constraint. A model cannot provide dependable guidance from outdated policies or incomplete documentation. Voice fluency can make weak information sound more certain.

Companies need governed data sources, retrieval tests, and clear ownership for corrections. A searchable AI knowledge base can help organize source material, but it does not replace access controls.

Evaluation should focus on completed work rather than impressive dialogue. Teams can measure correct tool selection, successful task completion, recovery from failure, and human escalation rates.

They should also test interruption behavior. Users will change their minds, add constraints, and talk over the assistant. A system that performs well only in orderly conversations is not ready.

Latency needs separate measurement at each stage. Time to first audio describes how quickly the agent begins responding. It does not reveal how long the full task takes.

A model might speak quickly but complete a workflow slowly. Another might pause longer before giving a more complete answer. Product teams need thresholds tied to the actual user journey.

Google’s partner list includes voice infrastructure providers and enterprise software companies. That suggests the company wants Gemini 3.8 Live embedded within broader systems, rather than limited to Google’s own interfaces.

Those partners can simplify media transport, orchestration, and deployment. They cannot remove the need for application-specific safeguards.

The most credible early deployments will use constrained tasks with observable outcomes. They will not begin by giving a general voice agent unrestricted access to an entire company.

Gemini 3.8 Live makes ambitious experiences easier to prototype. The enterprise opportunity depends on whether those prototypes become controlled, testable workflows.

Three Signals Will Show Whether Extended Thinking Works

The next test is adoption under real operational pressure, not another polished voice demonstration.

The first signal is production behavior from developers using the new API endpoints. Teams should watch error rates, session stability, interruption handling, and the reliability of asynchronous function calls.

Extended Thinking requires clients to track an interaction beyond a single spoken turn. Reports of duplicated calls, premature idle states, or confusing status narration would weaken Google’s design case.

Evidence that developers can migrate cleanly and maintain stable long sessions would strengthen it. Reusable orchestration patterns from platforms such as LiveKit, LangChain, and Pipecat would also lower adoption friction.

The second signal is broader availability across Google’s enterprise and productivity products. Several experiences are launching through previews or limited customer access.

A wider release in Workspace and the Gemini Enterprise Agent Platform would show confidence in the model’s operational controls. Persistent preview status would suggest that integration and governance still need work.

Usage inside Docs, Gmail, Keep, Search, and customer-experience systems will reveal which tasks suit spoken reasoning. Repeated use matters more than novelty-driven trials.

The third signal is the competitive response. OpenAI, xAI, and other providers can answer with lower latency, better agent completion, clearer lifecycle controls, or stronger telephony support.

Leaderboard movement will provide one view, but developer behavior will be more revealing. A model wins only when teams trust it enough to connect real tools and keep it running.

Google’s two-model strategy creates a clear hypothesis. Fast dialogue and deeper reasoning should remain separate options because each serves a different interaction budget.

That hypothesis will weaken if developers find routing burdensome or users dislike narrated waiting. It will strengthen if applications complete harder tasks without creating long, uncertain silence.

For buyers, the immediate step is a controlled comparison. Test both models on the same representative calls, including interruptions, failed tools, ambiguous requests, and sensitive actions.

Record task completion separately from conversational quality. Measure first-audio latency, total resolution time, tool accuracy, and escalation frequency.

Developers should also test how often Extended Thinking adds value over standard Live. The deeper model should earn its place through better outcomes, not a more elaborate response.

Gemini 3.8 Live changes the voice AI race because it treats ongoing reasoning as part of the user experience. It does not establish that every difficult task belongs in a spoken interface.

The next one to three months should clarify whether background reasoning improves real workflows or merely makes waiting sound smoother. Which result would matter most in your product: faster speech, stronger completion, or clearer control over both?

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page