thu-pacman / chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
1,026Updated this week

Alternatives and similar repositories for chitu:

Users that are interested in chitu are comparing it to the libraries listed below