SJTU-IPADS / PowerInferLinks

High-speed Large Language Model Serving for Local Deployment
8,213Updated 3 months ago

Alternatives and similar repositories for PowerInfer

Users that are interested in PowerInfer are comparing it to the libraries listed below

Sorting: