Cartesia

Cartesia

Cartesia Sonic-3.5 + Ink-2: One Stack to Rule Voice Agents

Cartesia Sonic-3.5 + Ink-2: One Stack to Rule Voice Agents

Jun 18, 20267 min readBy Cartesia Blog

Cartesia shipped two models on June 16, 2026, and the combination matters more than either one alone. Sonic-3.5 is a streaming text-to-speech model. Ink-2 is a streaming speech-to-text model. Together, they form what Cartesia is positioning as a unified real-time voice stack built specifically for AI agents. Not for podcast production. Not for audiobook narration. For agents that need to speak and listen simultaneously, at scale, without flinching on latency. This is not an incremental release. The underlying architecture — State Space Models (SSMs) rather than the transformer-based approach most competitors use — represents a different fundamental bet about what voice agents actually need. And if the benchmarks hold under real production loads, that bet is paying off.

What Shipped, Exactly

Sonic-3.5 handles TTS. Ink-2 handles STT. Both are streaming-first, meaning they are designed to operate on partial audio and partial text in real time, not to wait for complete utterances before processing. Cartesia and its investors are publicly claiming both models hold the #1 position on leading AI streaming benchmarks for their respective tasks. The STT side is where the external data is most concrete. According to Soniox's benchmark table, Ink-2 posts:

MetricInk-2 Result
Word Error Rate (English set 1)1.47%
Word Error Rate (English set 2)1.25%
Partial latency (set 1)~299 ms
Partial latency (set 2)~328 ms
Final latency~1,584 ms
Effective cost~$0.43/hr

Both AWS and Deepgram entries on that same benchmark table trail Ink-2 on accuracy and latency. That is not a press release claim. That is a third-party benchmark table that any engineering team can inspect directly.

The Architecture Argument

Most TTS and STT providers in 2026 are running on transformer-based architectures optimized for quality at the expense of latency. ElevenLabs v3, for instance, is explicitly positioned around narrator-grade, long-form audio. That is a legitimate product choice for audiobook publishers and content studios. It is not the right optimization for a customer service agent that needs to respond in under 400 ms while handling barge-ins, background noise, and simultaneous transcription for compliance logging. SSMs process sequential data with fundamentally different computational properties than transformers. They avoid the quadratic attention scaling problem that makes transformers expensive at long contexts, and they maintain state more efficiently across time steps. For streaming audio specifically, that architectural difference translates into lower tail latency and more predictable performance under sustained load, both of which matter enormously for always-on agent workloads. The community coverage framing this as Sonic-3.5 vs. ElevenLabs v3 is missing the point. ElevenLabs v3 wins on studio-grade narration. Cartesia wins on streaming conversational agents. These are different markets with different success metrics, and the engineers who conflate them will make bad architecture decisions.

Who Should Care Right Now

If you are building in any of these categories, this release demands a bake-off against your current provider before your next planning cycle: High-volume call centers. Ink-2's $0.43/hr effective cost at sub-350 ms partial latency is a meaningful combination. If you are running 50,000 call minutes per day through a more expensive STT provider with 600 ms partial latency, you are paying more for worse user experience. Run the numbers on your actual call volume. Fraud verification and financial services. Real-time transcription with sub-1.6 second final latency opens up patterns that were previously impractical: mid-call anomaly detection, live compliance flagging, real-time agent coaching overlays. If your current STT pipeline is producing transcripts 3-5 seconds after utterances, you are building analytics, not real-time intervention. Healthcare voice workflows. The accuracy numbers matter here more than anywhere else. A 1.25-1.47% WER on English is meaningfully better than what most teams are running on clinical dictation or patient triage systems. That delta compounds over thousands of interactions. AI agent platforms. If you are building a voice interface layer that other developers sit on top of, you need to make a stack decision now. OpenAI's Realtime API gives you a vertically integrated but locked path. A Sonic-3.5 + Ink-2 combination gives you a streaming-first stack with more architectural flexibility.

Cartesia vs. the Competitive Field

The honest competitive picture as of June 2026:

ProviderPrimary StrengthPrimary Weakness for Agents
Cartesia Sonic-3.5 + Ink-2Streaming-first, SSM architecture, unified stackNewer entrant, less enterprise track record
ElevenLabs v3Narrator-grade audio quality, voice cloningNot optimized for streaming conversational latency
OpenAI Realtime APITight LLM integration, single vendor simplicityVendor lock-in, less control over ASR/TTS separately
AWS Transcribe + PollyEnterprise compliance, ecosystem integrationTrails on both accuracy and latency per benchmarks
DeepgramStrong STT specialist, good developer experienceTrails Ink-2 on Soniox benchmark metrics

Cartesia's actual competitive advantage is not that it beats every competitor on every metric. It is that it is the only provider treating TTS and STT as a single coherent streaming system rather than two separate APIs you bolt together. That architectural coherence matters when you need features like tight barge-in handling, echo robustness, and conversational prosody that requires the synthesis layer to know what the recognition layer just heard.

The Operational Shift Nobody Is Talking About

Most of the coverage this week will focus on benchmark numbers and demo clips. That is the wrong frame. The deeper impact of Sonic-3.5 + Ink-2 is operational: a unified, low-latency TTS+STT stack makes it feasible to architect fully event-driven, multimodal agents where speech is just another token stream alongside text and tool calls. That unlocks patterns that were previously either impossible or required significant custom infrastructure:

  • Fine-grained interruption handling. When your STT and TTS share an architecture and a runtime, you can interrupt synthesis mid-token based on what the user just started saying, not after a full utterance completes.
  • Real-time fraud signals during active calls. Continuous STT with sub-300 ms partial latency means you can run classifiers on the live transcript before the caller finishes speaking.
  • Continuous learning loops. Every conversation generates aligned audio-transcript pairs that can feed back into model fine-tuning, closing the loop between production data and model improvement.

Teams that adopt Sonic-3.5 + Ink-2 as a drop-in replacement for their existing TTS and STT providers will capture maybe 20% of the available value: better accuracy, lower latency, potentially lower cost. Teams that redesign their interaction models and data pipelines around streaming bidirectional voice as a first-class interface will capture the rest.

How to Evaluate This: A Practical Framework

Do not run a benchmark on clean audio from a studio microphone and call it a decision. Run your evaluation on conditions that reflect your actual production environment:

Test with your dominant accent distributions. If 40% of your call volume comes from non-native English speakers, your evaluation audio should reflect that.

Test under load. Tail latency at the 95th and 99th percentile matters more than median latency for user experience. Request load test support directly from Cartesia.

Test barge-in scenarios explicitly. Record real examples of users interrupting mid-response and measure how cleanly each provider handles the transition.

Measure noise robustness. Call center environments, mobile handsets, and VoIP compression all degrade audio. Your benchmark should too.

Build against an abstraction layer. Do not call Cartesia's API directly from your core agent logic. Build a pluggable ASR/TTS interface so you can run parallel providers in production and swap without a rewrite. The model iteration pace in 2026 makes provider portability a technical requirement, not a nice-to-have.

The Recommendation

Run the bake-off. Do not wait for a case study from your industry vertical. The benchmark data from Soniox is public, the architecture rationale is sound, and the competitive positioning against AWS and Deepgram is based on third-party numbers, not vendor claims. For teams currently on AWS Transcribe or Deepgram for high-volume STT workloads: the latency and accuracy numbers alone justify a 30-day evaluation sprint. The cost profile is favorable enough that even a marginal improvement in WER at your call volume likely pays for the migration effort. For teams currently on ElevenLabs: the comparison is more nuanced. If your primary use case is long-form narration or high-production-value voice cloning, ElevenLabs v3 remains the stronger choice. If you are building conversational agents that need to speak and listen in real time, Cartesia is now the more architecturally aligned option. For teams building net-new voice agent infrastructure in 2026: Sonic-3.5 + Ink-2 should be your default starting point, with the explicit assumption that you will maintain provider portability as both Cartesia and the broader market continue to iterate rapidly.

What Comes Next

The competitive dynamic in voice infra is converging on a single question: who owns the real-time conversational layer for AI agents. OpenAI is pursuing that through LLM-native integration. ElevenLabs is pursuing it through quality and voice identity. Cartesia is pursuing it through streaming architecture and the thesis that SSMs are fundamentally better suited to always-on agent workloads than transformers. If Cartesia can maintain and extend its lead on the specific metrics that define agent performance, including tail latency under sustained load, barge-in accuracy, echo robustness, and conversational prosody, then the incumbents who optimized for studio-grade non-interactive audio face a structural problem. They built for a market that is shrinking in relative importance while the streaming agent market is growing fast. The June 16 release is the clearest signal yet that Cartesia is not building a better microphone. It is building the voice layer for the agent stack. Engineering teams that recognize that distinction early will have the architecture to take advantage of it. Those that treat this as a commodity API swap will get some of the benefit and miss most of the opportunity.

Ready to elevate your app with advanced voice AI?

Join top developers using Cartesia’s real-time TTS API to engage users and create lifelike conversational agents.

CartesiaCartesia

Actionable voice AI tips for product builders.

© 2026 Cartesia. All rights reserved.

Cartesia — Cartesia Sonic-3.5 + Ink-2: One Stack to Rule Voice Agents