LM Studio

Ollama

Run powerful AI models locally on your machine.

Ollama allows users to run large language models directly on their local hardware, providing privacy and speed without relying on cloud services. It supports a variety of models and is optimized for both CPU and GPU usage. The tool is ideal for developers and researchers who need offline access to AI capabilities.

Hyperbolic

Decentralized GPU cloud & open-source AI inference engine

Hyperbolic is a decentralized AI computing network and inference platform that provides high-performance, cost-effective GPU compute and open-access LLM APIs. By aggregating global GPU infrastructure with cryptographic verification of compute, Hyperbolic delivers up to 75% cost savings on frontier open-source model inference compared to traditional cloud hyperscalers. Hyperbolic serves the fastest and most affordable APIs for open-source models including DeepSeek R1/V3, Llama 3.3 70B, Qwen 2.5, and SDXL with full OpenAI-compatible API endpoints.

RunPod

Globally distributed GPU cloud and serverless platform for AI inference and training

RunPod is a leading globally distributed GPU cloud and serverless computing platform engineered specifically for artificial intelligence workloads. It provides developers, AI researchers, and enterprises with on-demand access to top-tier NVIDIA GPUs (including H100, A100, L40S, and RTX 4090) at up to 80% lower cost than traditional legacy hyperscalers.

vLLM

High-throughput and memory-efficient LLM serving engine powered by PagedAttention.

vLLM is the industry-standard open-source LLM serving and inference engine designed for ultra-high throughput and minimal memory waste. Developed by UC Berkeley researchers, vLLM introduced PagedAttention—a revolutionary memory management algorithm that manages attention key-value (KV) cache like virtual memory in operating systems, virtually eliminating memory fragmentation. Capable of delivering 2x to 4x higher throughput than Hugging Face TGI and standard PyTorch runtimes, vLLM powers production AI inference infrastructure across enterprise cloud clusters and high-volume API providers worldwide.

Cursor Directory

Curated library of system prompts, framework templates, and .cursorrules for AI engineers

Cursor Directory is the leading open repository of specialized system prompts, framework rules, and `.cursorrules` configurations for Cursor IDE and modern AI coding assistants. It helps developers immediately optimize AI responses for specific technology stacks, from Next.js and Tailwind to Rust, LangChain, and Python backend microservices. Engineered by developers for developers, the platform categorizes community-tested rules by framework, language, and architectural design pattern. Instead of writing verbose context prompts on every task, developers can drop these `.cursorrules` directly into their repository root to enforce clean code conventions, typed schemas, and idiomatic practices effortlessly.

Raycast

Extensible AI-powered launcher for power users

Raycast replaces standard OS launchers with a command-driven interface for apps, scripts, and AI. It provides quick access to AI chat, translations, and custom workflows.