2 docs tagged with "production-patterns"

Managing context windows, conversation history, and state across sessions - sliding window, summarization compression, hierarchical context, KV cache management, and context budget allocation for production LLM systems.

Battle-tested engineering patterns for deploying LLM applications at scale - context management, streaming, async calls, batching, retries, cost optimization, multi-tenancy, and AI product architecture.