Portkey

PortkeySince 2025-07

Portkey is an enterprise-grade AI Gateway and LLMOps control plane designed to make production AI applications fast, reliable, and cost-efficient. By acting as a unified proxy between your applications and 250+ LLMs, Portkey handles automated provider fallbacks, load balancing, rate-limiting, and semantic caching with zero code changes. Engineering teams use Portkey to eliminate single-provider downtime risks (e.g. automatic failover from OpenAI to Anthropic during outages) while cutting inference latency and API costs by up to 40% through intelligent semantic caching.

Portkey provides comprehensive real-time observability, tracing every request, token cost, and latency percentile in a unified dashboard. The gateway supports fine-grained budget limits, user-level rate-limiting, and content moderation guardrails to protect production systems from abuse. With ultra-fast 10ms gateway overhead and SOC 2 Type II compliance, Portkey is engineered for high-throughput enterprise workloads.

SmolagentsSince 2026-01

Smolagents is an ultra-lightweight, code-first Python framework created by Hugging Face for building, orchestrating, and executing autonomous AI agents in minimal lines of code. Rejecting the bloated, multi-layered abstractions of legacy agent libraries, Smolagents emphasizes 'Code Agents'—agents that express their reasoning and tool actions directly in executable Python code rather than rigid JSON string payloads. By letting LLMs write executable Python logic, Smolagents achieves vastly superior composability for data manipulation, mathematical operations, and complex loops while cutting prompt token overhead by up to 30%.

Smolagents natively supports both local open-source models (via Hugging Face Transformers and Ollama) and commercial frontier models (via LiteLLM, OpenAI, and Anthropic APIs). It includes pre-built modules for secure sandboxed Python execution, multi-modal web browsing agents with visual comprehension, and seamless sharing of agent tools directly on the Hugging Face Hub. The framework is fully modality-agnostic, supporting text, speech, vision, and custom API tools with zero vendor lock-in.