inference
Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.
Découvrez les skills Tests et sécurité, comparez leurs dépôts et consultez leurs instructions.
Fast inference with Unsloth and vLLM backend. Covers model loading, fast_generate(), thinking model output parsing, and memory management for efficient inference.
Runtime verification tests for bazzite-ai installation. Tests GPU detection, CUDA, PyTorch, service health, network connectivity, and pod lifecycles. Use when users need to verify their bazzite-ai installation...
Supervised Fine-Tuning with SFTTrainer and Unsloth. Covers dataset preparation, chat template formatting, training configuration, and Unsloth optimizations for 2x faster instruction tuning. Includes thinking mo...
GPU passthrough and virtualization for Bazzite. KVM/VFIO setup, Looking Glass (kvmfr), USB hotplug for VMs, and libvirt configuration. Use when users need GPU passthrough or advanced virtualization features.
Security configuration for Bazzite. LUKS disk encryption with TPM auto-unlock, secure boot key management, and sudo password feedback. Use when users need to configure security features.
FiftyOne dataset visualization and curation tool via Podman Quadlet. Multi-container architecture with MongoDB sidecar for dataset persistence. GPU-accelerated for ML workflows. Use when users need to configure...
Storage management for Bazzite. Automounting drives (BTRFS/EXT4, Framework, SteamOS), BTRFS deduplication, rmlint disk trimming, and snapper snapshots. Use when users need to configure disk and partition manage...
Open WebUI AI chat interface management via Podman Quadlet. Provides a web UI for interacting with Ollama models. Use when users need to configure, start, or manage the Open WebUI service.
Distrobox container management for Bazzite. Create containers from manifests, custom containers, app-specific containers (brew), and DaVinci Resolve installation. Use when users need to work with distrobox cont...
Third-party application installation for Bazzite. CoolerControl, DisplayLink, JetBrains Toolbox, OpenRazer, tablet drivers, scrcpy, and more. Use when users need to install hardware-specific or specialized appl...
Direct REST API operations for Ollama using the requests library. Covers all /api/* endpoints for model management, text generation, chat completion, embeddings, and streaming responses.
GPU monitoring and performance metrics for Ollama inference. Check GPU status, VRAM usage, loaded models, and inference performance metrics like tokens per second.
Direct Preference Optimization for learning from preference pairs. Covers DPOTrainer, preference dataset preparation, implicit reward modeling, and beta tuning for stable preference learning without explicit re...
System maintenance for Bazzite OS. Updates via topgrade, cleanup of podman/flatpaks, viewing logs and changelogs, diagnostics, and power measurements. Use when users need to update, clean, or diagnose their Baz...
Jellyfin media server management via Podman Quadlet. Supports multi-instance deployment, hardware transcoding (NVIDIA/AMD/Intel), and FUSE filesystem mounts. Use when users need to set up or manage Jellyfin med...
Transformer architecture fundamentals. Covers self-attention mechanism, multi-head attention, feed-forward networks, layer normalization, and residual connections. Essential concepts for understanding LLMs.
Development: Cleanup and maintenance for the development environment. Removes build artifacts, caches, containers, and recovers disk space. Run from repository root with 'just clean'. Use when developers need t...
Self-hosted GitHub Actions runner management via Podman Quadlet. Supports multi-instance pools with ephemeral storage, automatic token generation, and rolling updates. Use when users need to set up CI/CD runner...
Reinforcement Learning with Leave-One-Out estimation for policy optimization. Covers RLOOTrainer, reward function integration, baseline estimation, and variance reduction techniques for stable RL training. Incl...
Retrieval-Augmented Generation (RAG) for grounding LLM responses with external knowledge. Covers document chunking, embeddings, vector stores (pandas, ChromaDB), similarity search, and conversational RAG pipeli...
Desktop customization for Bazzite. GTK theme restoration, terminal transparency, and MOTD settings. Use when users need to customize their desktop appearance.
Import GGUF models from HuggingFace into Ollama. Pull models directly using the hf.co/ prefix, track download progress, and use imported models for inference.
LocalAI local inference API management via Podman Quadlet. Provides an OpenAI-compatible API for local model inference with GPU acceleration. Use when users need to configure, start, or manage the LocalAI servi...
Official ollama Python library for LLM inference. Provides a clean, Pythonic interface for text generation, chat completion, embeddings, model management, and streaming responses.
Le classement utilise les étoiles du dépôt GitHub indexé. Plusieurs skills peuvent partager ce nombre : ce n’est ni un nombre d’installations ni une note de qualité.