laelhalawani / gguf_modeldb
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb:
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆42Updated last month
- ☆21Updated 4 months ago
- run ollama & gguf easily with a single command☆49Updated 8 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 8 months ago
- High level tool use for LLMs☆34Updated 5 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- Web Interface for Vision Language Models Including InternVLM2☆16Updated 5 months ago
- A QT GUI for large language models☆26Updated last year
- Large-Language-Model to Machine Interface project.☆17Updated last year
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 7 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 6 months ago
- Embed anything.☆28Updated 7 months ago
- ☆18Updated 3 weeks ago
- ☆25Updated 4 months ago
- ☆30Updated 6 months ago
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆23Updated 4 months ago
- ☆21Updated 5 months ago
- AirLLM 70B inference with single 4GB GPU☆12Updated 5 months ago
- ☆30Updated 8 months ago
- A discord bot to stay up to date with Hugging Face Daily Papers.☆15Updated 9 months ago
- ☆38Updated last year
- This repo provides a simple Gradio UI to run Qwen2 VL 72B AWQ in venv and have both image and video inferencing work.☆26Updated 3 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆18Updated 3 weeks ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆81Updated 3 weeks ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated 11 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆58Updated 4 months ago
- ☆30Updated 10 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated last year
- ☆39Updated 11 months ago