NVIDIA DGX Cloud Lepton

NVIDIA DGX Cloud LeptonSince 2023-08

NVIDIA DGX Cloud Lepton (formerly Lepton AI, acquired by NVIDIA) is an AI-centric compute marketplace and model serving platform that connects developers to tens of thousands of GPUs across a global network of NVIDIA Cloud Partners (including CoreWeave, Lambda, and tier-1 clouds). Founded by Yangqing Jia (creator of Caffe) and acquired by NVIDIA, DGX Cloud Lepton functions like a high-performance compute marketplace for AI engineering teams. It allows developers to discover available GPU compute across regions and seamlessly deploy, fine-tune, and scale AI workloads with zero Kubernetes overhead.

DGX Cloud Lepton integrates directly with the full NVIDIA enterprise software stack, including NVIDIA NIM (Inference Microservices), NeMo, and NVIDIA Cloud Functions. Developers use Python Photons and simple CLI commands to turn arbitrary PyTorch scripts into auto-scaling microservices running on NVIDIA H100, H200, and Blackwell B200 clusters. The platform provides heterogeneous multi-cloud abstraction, automatic load balancing, scale-to-zero serverless runtimes, and distributed key-value storage, giving enterprise teams instant access to reserved and spot GPU capacity with guaranteed NVIDIA driver and CUDA acceleration.

KestraSince 2022-06

Kestra is an open-source, event-driven orchestration platform built to automate and coordinate complex data pipelines, microservices, and multi-agent AI systems. With a modern declarative YAML-first architecture, Kestra enables engineering teams to manage scheduled tasks, webhook triggers, distributed compute jobs, and LLM agent pipelines through code or a rich interactive UI. The platform provides over 600+ pre-built plugins spanning major cloud providers (AWS, GCP, Azure), databases (Postgres, Snowflake, BigQuery), and modern AI ecosystems (OpenAI, LangChain, Hugging Face, Vector DBs). Workflows can execute parallel compute tasks, branch conditionally, manage secrets securely, and handle automated retries with exponential backoff. Kestra eliminates the operational overhead of legacy orchestrators by running statelessly on top of modern container runtimes and Kubernetes, providing real-time workflow visualizers, sub-millisecond execution triggers, and enterprise-grade role-based access control.

Kestra’s architecture is built around an event-driven core powered by Apache Kafka or PostgreSQL for distributed queuing and high-throughput execution guarantees. Each workflow is version-controlled in Git as a declarative YAML specification, enabling full CI/CD integration and infrastructure-as-code automation. For AI engineering, Kestra serves as the deterministic execution backbone: triggering RAG indexing pipelines, coordinating distributed fine-tuning runs, provisioning transient GPU containers, and validating agent tool calls against production database replicas. The platform includes embedded Python, Node.js, and Bash script runners with isolated container sandboxes, comprehensive OpenTelemetry distributed tracing, and real-time execution dashboards.