k-koehler / gguf-tensor-overriderView external linksLinks
☆52Oct 10, 2025Updated 4 months ago
Alternatives and similar repositories for gguf-tensor-overrider
Users that are interested in gguf-tensor-overrider are comparing it to the libraries listed below
Sorting:
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆51Aug 21, 2025Updated 5 months ago
- JotItNow is a AI Voice Notes App☆24Mar 6, 2025Updated 11 months ago
- A forward proxy to turn network traffic into personal memory for AI agents☆33Jan 6, 2026Updated last month
- Orchestrator Kit for Agentic Reasoning - OrKa is a modular AI orchestration system that transforms Large Language Models (LLMs) into comp…☆88Jan 10, 2026Updated last month
- An fully autonomous agent that accesses the browser and performs tasks.☆17Apr 25, 2025Updated 9 months ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆76Updated this week
- Benchmarking tool for vLLM inference performance with GPU monitoring☆40Nov 24, 2025Updated 2 months ago
- llama-benchy - llama-bench style benchmarking tool for all backends☆46Feb 8, 2026Updated last week
- CompChomper is a framework for measuring how LLMs perform at code completion.☆19Apr 29, 2025Updated 9 months ago
- ☆51Feb 19, 2025Updated 11 months ago
- MeshBBS is a lightweight, text-based bulletin board system designed to run over Meshtastic radios, enabling simple games, utilities, and …☆50Oct 17, 2025Updated 4 months ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆30May 18, 2025Updated 8 months ago
- Service for testing out the new Qwen2.5 omni model☆63Apr 30, 2025Updated 9 months ago
- ☆94Jul 7, 2025Updated 7 months ago
- Loader extension for tabbyAPI in SillyTavern☆26Jun 30, 2025Updated 7 months ago
- An extension of MCP for SillyTavern.☆74Jul 26, 2025Updated 6 months ago
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆58Jan 16, 2026Updated last month
- Fully autonomous AI development agent with stateful memory, live web access, pseudo self-improvement and more!☆64Feb 9, 2026Updated last week
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 2 months ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆35Oct 21, 2025Updated 3 months ago
- llama-swap + a minimal ollama compatible api☆46Jan 23, 2026Updated 3 weeks ago
- Orpheus Chat WebUI☆76Mar 27, 2025Updated 10 months ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆36Jul 2, 2025Updated 7 months ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Mar 15, 2025Updated 11 months ago
- Official PyTorch implementation of "GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance" (ICML 2025)☆50Jul 6, 2025Updated 7 months ago
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆50Nov 26, 2025Updated 2 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆29Jan 19, 2025Updated last year
- A zero-dependency prompt manager/catalog/library in a single HTML file. Everything is stored locally in your browser. Meow. 😼☆62Aug 14, 2025Updated 6 months ago
- Run Orpheus 3B Locally With LM Studio☆32Mar 20, 2025Updated 10 months ago
- Repository for CoSAI Workstream 4, Secure Design Patterns for Agentic Systems☆86Updated this week
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Jan 7, 2026Updated last month
- 【python】初體驗-俄羅斯方塊 遊戲☆11Apr 4, 2020Updated 5 years ago
- An AI assistant building SDK in python☆42Sep 21, 2025Updated 4 months ago
- Text to audio with Tik-Tok Voices☆13Apr 6, 2023Updated 2 years ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆157Updated this week
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated 11 months ago
- Local first human friendly agents toolkit for the browser and Nodejs☆45Feb 2, 2026Updated 2 weeks ago
- hopfield☆30Oct 8, 2021Updated 4 years ago