ai-llm-inference

Features and purpose

Operational patterns for LLM inference: latency budgeting, tail-latency control, caching, batching/scheduling, quantization/compression, parallelism, and reliable serving at scale. Emphasizes production-grade performance, cost control, and observability.

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.