Langfuse

LangfuseSince 2025-06

Langfuse is an open-source LLM engineering and observability platform built for teams developing production-grade generative AI applications and autonomous multi-agent pipelines. It captures granular traces across token usage, prompt versions, latency bottlenecks, and retrieval accuracy, giving developers complete visibility into model behavior at runtime. By integrating seamlessly with major AI frameworks such as LangChain, LlamaIndex, LiteLLM, and the OpenAI SDK, Langfuse eliminates the guesswork from debugging complex agent execution trees. Developers can monitor production cost metrics, identify hallucinated responses, and run rigorous continuous evaluation suites on live traffic.

The platform architecture features asynchronous tracing hooks that introduce negligible latency overhead to live user interactions. Teams can set up human-in-the-loop scoring, programmatic assertion checks, and automated LLM-as-a-judge evaluations to benchmark prompt iterations against golden test datasets. Langfuse is fully open-source with MIT licensing, allowing organizations with strict data governance policies to self-host the complete observability stack on private Kubernetes clusters or AWS VPCs while maintaining identical enterprise dashboard ergonomics.

LiveKit AgentsSince 2026-08

LiveKit Agents is an open-source real-time communication framework engineered to build conversational voice, video, and multimodal AI agents with sub-500ms latency. Leveraging WebRTC, it connects speech-to-text (Deepgram, Whisper), LLMs (OpenAI, Anthropic), and text-to-speech (Cartesia, ElevenLabs) in a tightly synchronized bidirectional stream. From customer service avatars to interactive language tutors and hands-free coding copilots, LiveKit Agents provides the enterprise infrastructure for real-time human-AI interaction.

Building real-time voice agents requires solving audio interruption, packet jitter, and latency stacking. LiveKit Agents abstracts these challenges with native Voice Activity Detection (VAD), turn-taking management, and edge-routed audio pipelines. Available in Python and Node.js with client SDKs across React, iOS, Android, and Flutter, LiveKit enables developers to self-host their agent backend or deploy onto LiveKit Cloud.