laelhalawani / gguf_modeldb
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for gguf_modeldb
- Local LLM inference & management server with built-in OpenAI API☆31Updated 7 months ago
- ☆39Updated 9 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆36Updated 9 months ago
- Complex RAG backend☆28Updated 7 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆25Updated 11 months ago
- AnyModal is a Flexible Multimodal Language Model Framework☆40Updated this week
- A QT GUI for large language models☆24Updated 10 months ago
- Large-Language-Model to Machine Interface project.☆17Updated 11 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 3 weeks ago
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆18Updated 3 weeks ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated 11 months ago
- ☆15Updated 8 months ago
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆15Updated last week
- ☆16Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 6 months ago
- Embed anything.