☆53Oct 10, 2025Updated 4 months ago
Alternatives and similar repositories for gguf-tensor-overrider
Users that are interested in gguf-tensor-overrider are comparing it to the libraries listed below
Sorting:
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- ☆94Jul 7, 2025Updated 8 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆53Aug 21, 2025Updated 6 months ago
- A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.☆23Jan 2, 2026Updated 2 months ago
- JotItNow is a AI Voice Notes App☆24Mar 6, 2025Updated last year
- Orchestrator Kit for Agentic Reasoning - OrKa is a modular AI orchestration system that transforms Large Language Models (LLMs) into comp…☆90Feb 25, 2026Updated last week
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…☆79Feb 22, 2026Updated 2 weeks ago
- An fully autonomous agent that accesses the browser and performs tasks.☆17Apr 25, 2025Updated 10 months ago
- Implements harmful/harmless refusal removal using pure HF Transformers☆21May 8, 2025Updated 10 months ago
- A forward proxy to turn network traffic into personal memory for AI agents☆36Feb 23, 2026Updated 2 weeks ago
- Benchmarking tool for vLLM inference performance with GPU monitoring☆41Nov 24, 2025Updated 3 months ago
- CompChomper is a framework for measuring how LLMs perform at code completion.☆21Apr 29, 2025Updated 10 months ago
- ☆51Feb 19, 2025Updated last year
- A simple, observable code-writing agent builder in TypeScript.☆30Apr 9, 2025Updated 11 months ago
- Loader extension for tabbyAPI in SillyTavern☆26Jun 30, 2025Updated 8 months ago
- Service for testing out the new Qwen2.5 omni model☆63Apr 30, 2025Updated 10 months ago
- ☆24Jan 22, 2025Updated last year
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆58Jan 16, 2026Updated last month
- Fully autonomous AI development agent with stateful memory, live web access, pseudo self-improvement and more!☆67Feb 9, 2026Updated last month
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 3 months ago
- ☆24Apr 25, 2025Updated 10 months ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆35Feb 11, 2026Updated 3 weeks ago
- Orpheus Chat WebUI☆75Mar 27, 2025Updated 11 months ago
- Official PyTorch implementation of "GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance" (ICML 2025)☆50Jul 6, 2025Updated 8 months ago
- Study and research with your docs, media, and AI in one place☆34Updated this week
- llama-swap + a minimal ollama compatible api☆51Feb 13, 2026Updated 3 weeks ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆37Jul 2, 2025Updated 8 months ago
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆52Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆29Jan 19, 2025Updated last year
- The High Performance LLM Native Mock Server☆19Jan 8, 2026Updated 2 months ago
- A zero-dependency prompt manager/catalog/library in a single HTML file. Everything is stored locally in your browser. Meow. 😼☆65Aug 14, 2025Updated 6 months ago
- Run Orpheus 3B Locally With LM Studio☆32Mar 20, 2025Updated 11 months ago
- An AI assistant building SDK in python☆43Sep 21, 2025Updated 5 months ago
- Text to audio with Tik-Tok Voices☆13Apr 6, 2023Updated 2 years ago
- An AI based platform for in-depth research about any topic☆28Mar 1, 2026Updated last week
- Thank you LenAnderson I am yoinking this!☆21Jan 13, 2026Updated last month
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆159Feb 27, 2026Updated last week
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆45Updated this week