gpu-inference-server

Features and purpose

Set up AI inference servers on cloud GPUs. Create private LLM APIs (vLLM, TGI), image generation endpoints, embedding services, and more. All with OpenAI-compatible interfaces that work with existing tools.

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.