Pipecat

Ultravox.ai

Speech-native voice AI agents

Ultravox.ai builds speech-native voice AI agents for real-time conversational interactions. It enables developers to integrate advanced voice capabilities into applications with low latency. The platform supports multiple languages and custom voice models for diverse use cases.

Cartesia

Ultra-low-latency real-time voice generation for AI agents

Cartesia is an AI audio and voice intelligence company that powers conversational AI agents and interactive applications with ultra-low-latency, hyper-realistic voice synthesis. Its flagship State Space Model (SSM) architecture, Sonic, delivers human-like voice generation with sub-90ms time-to-first-audio latency. While traditional transformer-based text-to-speech models struggle with high latency and compute overhead, Cartesia's lightweight SSM architecture allows developers to build fluid, conversational voice bots that feel instantaneous and natural, without awkward pauses. Cartesia is used by developers, contact centers, game studios, and AI agent builders across the world to power real-time phone assistants, gaming NPCs, live transcription translation, and voice-enabled enterprise interfaces.

LiveKit Agents

Open-source real-time WebRTC infrastructure for building ultra-low-latency voice and multimodal AI agents

LiveKit Agents is an open-source real-time communication framework engineered to build conversational voice, video, and multimodal AI agents with sub-500ms latency. Leveraging WebRTC, it connects speech-to-text (Deepgram, Whisper), LLMs (OpenAI, Anthropic), and text-to-speech (Cartesia, ElevenLabs) in a tightly synchronized bidirectional stream. From customer service avatars to interactive language tutors and hands-free coding copilots, LiveKit Agents provides the enterprise infrastructure for real-time human-AI interaction.

Moshi by Kyutai

Real-time full-duplex conversational voice AI model with sub-200ms latency

Moshi is an open-source real-time conversational voice AI foundation model developed by Kyutai, the non-profit AI research lab based in Paris. Engineered to revolutionize human-AI verbal communication, Moshi operates on a full-duplex architecture capable of listening, thinking, and speaking simultaneously with sub-200ms end-to-end latency. Unlike traditional voice assistants that chain separate Speech-to-Text (STT), Large Language Model (LLM), and Text-to-Speech (TTS) pipelines together, Moshi processes raw multi-stream audio natively as continuous speech tokens. This allows Moshi to understand emotional nuances, interrupt and be interrupted naturally, chuckle, whisper, and express genuine conversational timing. Moshi is fully open-source with openly accessible weights, training recipes, and inference code, serving as a foundational milestone for research in real-time spoken language modeling and multi-modal conversational systems.

Deepgram

Real-time AI speech-to-text, text-to-speech, and voice agent API

Deepgram is an enterprise AI speech platform that provides world-class speech-to-text (STT), text-to-speech (TTS), and real-time voice agent APIs. Powered by end-to-end deep learning models like Nova-2 and Aura, Deepgram delivers industry-leading accuracy, sub-250ms latency, and high cost-efficiency for processing live conversational audio. Deepgram is the infrastructure backbone for next-generation conversational AI applications, customer service bots, meeting transcription engines, and autonomous voice agents. Its streaming WebSocket architecture allows models to transcribe noisy, multi-speaker phone audio in real time while simultaneously synthesizing natural, expressive voices with zero perceptible delay.

Udio

The most musical AI track generator

An AI music creation platform known for its exceptional audio fidelity and sophisticated musical arrangements across every imaginable genre.