unsloth-inference

Features and purpose

Deploying fine-tuned models for production inference using native kernel optimization, vLLM, or SGLang. Triggers: inference, serving, vllm, sglang, for_inference, model merging, openai api.

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.