laelhalawani / gguf_modeldb
A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b
☆12Updated last year
Alternatives and similar repositories for gguf_modeldb:
Users that are interested in gguf_modeldb are comparing it to the libraries listed below
- an auto-sleeping and -waking framework around llama.cpp☆11Updated 2 months ago
- ☆17Updated 4 months ago
- Complex RAG backend☆28Updated last year
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆21Updated 4 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆18Updated 10 months ago
- entropix style sampling + GUI☆25Updated 5 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆49Updated 2 months ago
- ☆28Updated 6 months ago
- ☆24Updated 3 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 8 months ago
- jQuery, React and Streamlit applications written by LLMs☆16Updated last year
- Voice agent using LiveKit (orchestration), Cartesia (TTS), OpenAI (LLM), and Deepgram (STT)☆15Updated 3 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆27Updated 3 months ago
- fork of litellm that is open source☆19Updated 4 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 10 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated 7 months ago
- Open source implementation for computer use, using light OCR models and LLMs.☆18Updated last week
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Updated 5 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- run ollama & gguf easily with a single command☆50Updated 11 months ago
- Build HTML artefacts with Ollama☆11Updated 4 months ago
- Web Interface for Vision Language Models Including InternVLM2☆21Updated 8 months ago
- MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…☆12Updated last month
- ☆30Updated 9 months ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆22Updated last month
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆56Updated 4 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 5 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆16Updated 7 months ago
- Use smol agents to do research and then update csv coumns with its findings.☆38Updated 2 months ago