robbiemu / llama-gguf-optimize
Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.
☆14Updated last month
Alternatives and similar repositories for llama-gguf-optimize:
Users that are interested in llama-gguf-optimize are comparing it to the libraries listed below
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆29Updated this week
- Build HTML artefacts with Ollama☆11Updated 2 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆20Updated last month
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆15Updated 3 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 9 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated last year
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆28Updated 3 weeks ago
- ☆16Updated 2 weeks ago
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆21Updated last week
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆14Updated 6 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆17Updated 4 months ago
- A forest of autonomous agents.☆19Updated 3 weeks ago
- Yet Another (LLM) Web UI, made with Gemini☆11Updated last month
- A swarm of LLM agents that will help you test, document, and productionize your code!☆13Updated last week
- BH hackathon☆14Updated 10 months ago
- Okra, your all in one personal AI assistant☆14Updated 8 months ago
- ☆12Updated last month
- 🧠 Mem4AI: A LLM Friendly memory management library.☆18Updated 3 months ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆20Updated 3 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆22Updated 7 months ago
- LLM Chat is an open-source serverless alternative to ChatGPT.☆31Updated 5 months ago
- Web Interface for Vision Language Models Including InternVLM2☆17Updated 6 months ago
- A QT GUI for large language models☆30Updated last year
- Large-Language-Model to Machine Interface project.☆17Updated last year
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆18Updated 5 months ago
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.