laelhalawani / gguf_modeldb
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb:
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
- ☆39Updated last year
- ☆24Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆91Updated 7 months ago
- Embed anything.☆29Updated 8 months ago
- Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF☆32Updated 11 months ago
- ☆38Updated last year
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆17Updated 8 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 10 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆58Updated 6 months ago
- run ollama & gguf easily with a single command☆49Updated 9 months ago
- ☆30Updated 7 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆111Updated 3 months ago
- ☆28Updated 4 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- Complex RAG backend☆28Updated 10 months ago
- ☆24Updated 3 weeks ago
- ☆111Updated 2 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆46Updated last month
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated 5 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated 2 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 8 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 8 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 8 months ago
- ☆15Updated 11 months ago
- ☆16Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆53Updated this week
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 4 months ago