laelhalawani / gguf_modeldbLinks
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
Sorting:
- an auto-sleeping and -waking framework around llama.cpp☆12Updated 9 months ago
- ☆17Updated 11 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Updated last year
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆18Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆53Updated 9 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆111Updated last year
- Complex RAG backend☆29Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆44Updated this week
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated last year
- Locally running LLM with internet access☆97Updated 4 months ago
- fork of litellm that is open source☆21Updated 11 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- ☆24Updated 10 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆28Updated 6 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- A framework for hosting and scaling AI agents.☆38Updated 11 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆25Updated 8 months ago
- Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF☆31Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- ☆134Updated 6 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆28Updated last year
- ☆15Updated 8 months ago
- ☆107Updated 3 weeks ago
- ☆30Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Embed anything.☆27Updated last year
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆128Updated last year
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated last year