transformer-architecture

Features and purpose

Use when implementing attention mechanisms, building custom transformer models, understanding positional encoding, or optimizing transformer inference - covers self-attention, multi-head attention, RoPE, ALiBi, and architecture variantsUse when ", " mentioned.

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.