laelhalawani / gguf_modeldbLinks
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
Sorting:
- ☆17Updated 11 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated last year
- A framework for hosting and scaling AI agents.☆38Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆12Updated 10 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆19Updated last year
- Complex RAG backend☆29Updated last year
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆28Updated 2 years ago
- fork of litellm that is open source☆21Updated 11 months ago
- Embed anything.☆27Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆54Updated 10 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆45Updated this week
- ☆107Updated last month
- Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF☆32Updated last year
- ☆30Updated last year
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆28Updated 7 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated last year
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated last year
- ☆24Updated 10 months ago
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- ☆134Updated 7 months ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Updated last year
- Moondream MCP Server in Python☆43Updated 5 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- Simple Chainlit UI for running llms from Groq and LangChain☆17Updated last year
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated last year
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆39Updated 9 months ago