laelhalawani / gguf_modeldbLinks
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
Sorting:
- Embed anything.☆28Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆63Updated 10 months ago
- run ollama & gguf easily with a single command☆52Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆93Updated last year
- ☆24Updated 5 months ago
- an auto-sleeping and -waking framework around llama.cpp☆12Updated 5 months ago
- ☆132Updated 2 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆57Updated 7 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated last year
- Complex RAG backend☆28Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆42Updated last month
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆18Updated last year
- ☆101Updated last month
- ☆39Updated last year
- fork of litellm that is open source☆20Updated 7 months ago
- Locally running LLM with internet access☆96Updated 2 weeks ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆43Updated 10 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆49Updated 5 months ago
- ☆17Updated 7 months ago
- entropix style sampling + GUI☆26Updated 8 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆74Updated 8 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 8 months ago
- ☆29Updated 9 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 9 months ago
- ☆30Updated last year
- High level tool use for LLMs☆34Updated 11 months ago
- Own your AI, search the web with it🌐😎☆86Updated 6 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆27Updated 2 months ago