AutoGPTQ

All

1 repository

AutoGPTQ
Public archive
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
nlp deep-learning transformers
nlp deep-learning transformers inference pytorch transformer quantization large-language-models llms
Python
•
MIT License
•538•5.1k•241•31•Updated Apr 11, 2025Apr 11, 2025

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.