DSPy

DSPySince 2026-08

DSPy is an open-source framework created by Stanford University that replaces fragile, manual prompt engineering with algorithmic programming and systematic optimization. Instead of hand-tweaking prompt strings and few-shot examples, DSPy allows developers to express multi-stage AI workflows as modular Python modules with declarative Signatures. DSPy’s teleprompter optimizers automatically synthesize optimal prompt instructions, select high-performing few-shot demonstrations, and fine-tune smaller local language model weights to maximize pipeline accuracy on defined validation metrics.

DSPy introduces a compiler-like mental model for building with Language Models. Developers define Signatures (input/output contracts like "question -> answer" or "context, query -> rationale, sql") and assemble them into Modules like ChainOfThought, ReAct, or MultiHop. When compiled against a small training set, DSPy systematically optimizes prompt variations and demonstration examples, often boosting pipeline performance by 20% to 40% while making pipelines resilient to underlying model swaps.

LlamaIndexSince 2023-01

LlamaIndex is the premier open-source data framework designed to bridge private, enterprise, and unstructured data with large language models. By providing sophisticated data connectors, automated parser modules, semantic chunking algorithms, and multi-document index structures, LlamaIndex enables developers to build context-augmented LLM applications and autonomous knowledge retrieval engines with minimal boilerplate. From parsing complex multi-page PDF documents and financial spreadsheets to orchestrating complex Agentic RAG workflows that query multiple disparate databases, LlamaIndex handles the complete data ingestion, indexing, and query evaluation lifecycle.

Architected for production scale, LlamaIndex provides seamless abstractions for 160+ vector stores, SQL databases, knowledge graphs, and data loaders through LlamaHub. Its query engine supports hybrid vector-lexical searches, sub-question query decomposition, recursive retrieval, and reranking pipelines. With native support for LlamaParse (a state-of-the-art vision-based document parser) and LlamaCloud (a managed parsing and retrieval service), enterprise engineering teams can deploy enterprise-grade RAG applications with strict accuracy evaluation benchmarks and low token consumption.