TsingmaoAI / MI-optimize
View external linksLinks

mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techniques empowers users to customize their approaches according to specific requirements and constraints, providing a high level of flexibility.
24Nov 28, 2024Updated last year

Alternatives and similar repositories for MI-optimize

Users that are interested in MI-optimize are comparing it to the libraries listed below

Sorting:

Are these results useful?