pytorch-quantization

Features and purpose

Techniques for model size reduction and inference acceleration using INT8 quantization, including Post-Training Quantization (PTQ) and Quantization Aware Training (QAT). (quantization, int8, qat, fbgemm, qnnpack, ptq, dequantize)

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.