GGUF Quantization of any LLM.
☆42Mar 4, 2024Updated 2 years ago
Alternatives and similar repositories for GGUF-Quantization-of-any-LLM
Users that are interested in GGUF-Quantization-of-any-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code Llama GGUF Demo☆10Aug 28, 2023Updated 2 years ago
- Medical Mixture of Experts LLM using Mergekit.☆22Mar 6, 2024Updated 2 years ago
- An easy-to-use ML pipeline package for Python inspired by scikit-learn pipeline and PyTorch layers.☆12Aug 27, 2023Updated 2 years ago
- SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.☆21Feb 11, 2024Updated 2 years ago
- 部署大模型到Android设备☆20Nov 16, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tools for CrewAI☆30May 12, 2024Updated 2 years ago
- Run models distributed as GGUF files using LLM