randaller / llama-cpuLinks
Inference on CPU code for LLaMA models
☆137Updated 2 years ago
Alternatives and similar repositories for llama-cpu
Users that are interested in llama-cpu are comparing it to the libraries listed below
Sorting:
- Inference code for facebook LLaMA models with Wrapyfi support☆129Updated 2 years ago
- Python bindings for llama.cpp☆199Updated 2 years ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.