Based on the implementation of Google's TurboQuant (ICLR 2026) — Quansloth brings elite KV cache compression to local LLM inference. Quansloth is a fully private, air-gapped AI server that runs massive context models natively on consumer hardware with ease
☆151May 13, 2026Updated 3 months ago
Alternatives and similar repositories for Quansloth
Users that are interested in Quansloth are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Describe an app. Get a desktop app. AI-powered generator that builds real Tauri applications from natural language.☆211Apr 2, 2026Updated 4 months ago
- AgentFM is a peer-to-peer network that turns everyday computers into a decentralized AI supercomputer. AgentFM lets you run massive AI wo…☆132Updated this week
- Hierarchical Agent Memory with Git-Like Version Control☆605Aug 1, 2026Updated 2 weeks ago
- Pure Rust Inference Engine☆654Updated this week
- Spellbound - your multilingual AI-powered writing assistant☆13May 12, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Generative Architectural Brain Base Engine - Agentic Software R&D Engineering Kit - development, all languages, agents, platforms, with E…☆21Aug 10, 2026Updated last week
- The Smallest English TTS Model with only 1M parameters☆510Apr 10, 2026Updated 4 months ago
- 🧠 Bio-Agent OS: 🇻🇳 Bio-Inspired Memory Framework for AI Agents (OpenClaw/ERP). Researched & Developed by Dev Tuan Anh Ha (Locaith Solu…☆20Updated this week
- Tessera — a workspace for organizing AI coding sessions across projects, collections, tabs, panes, and Git worktrees☆293Updated this week
- ~97% token reduction for AI coding sessions — zero deps, 33 languages, MCP server☆615Updated this week
- ⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-respon…☆18Updated this week
- Force any Model, VAE, or CLIP to any GPU or CPU—and keep it there (or don't).☆34Feb 6, 2026Updated 6 months ago
- LLM inference in C/C++☆2,291Updated this week
- SwizlyPeasy.Gateway is a simple API gateway based on YARP Reverse Proxy. This gateway should support OIDC authentication and service disc…☆10Aug 8, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLM speculative inference server for consumer & heterogeneous hardware☆2,762Updated this week
- Website using FinBERT + live financial news scraping to assess short-term investment potential.☆13Mar 7, 2025Updated last year
- Group Evolving Agents: Open-Ended Self-Improvement via Experience Sharing☆127Apr 7, 2026Updated 4 months ago
- ☆29Mar 31, 2026Updated 4 months ago
- Agentic AI server in Rust. Multi-provider LLM routing, tool calling, RAG, MCP, multi-tenant workflows.☆15Jun 18, 2026Updated 2 months ago
- AI PM (product management) assistant for AI coding IDEs (Cline, Cursor). Follows the detailed product_management_workflow_startup.md for …☆21Sep 13, 2025Updated 11 months ago
- ☆11Jul 22, 2026Updated 3 weeks ago
- ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.☆5,760Aug 6, 2026Updated last week
- Wan 2.1 for the GPU Poor☆20Jan 23, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A curated list of AI video generation APIs, SDKs, and tools including text-to-video, video editing, multimodal generation, diffusion mode…☆20Jun 17, 2026Updated 2 months ago
- Open-source coding agent like Cursor/Windsurf in your browser☆17Jul 9, 2025Updated last year
- Exact speculative decoding on Apple Silicon, powered by MLX.☆385Apr 20, 2026Updated 3 months ago
- ☆12Aug 21, 2022Updated 3 years ago
- AI-powered tweet optimization tool using DSPy with hill-climbing algorithm☆29Oct 15, 2025Updated 10 months ago
- Forkit Core is an open source passport layer for AI models and agents with GitHub CI validation, local verification, and Hugging Face-com…☆17Jun 9, 2026Updated 2 months ago
- ComfyUI nodes for local image refinement preprocessing, reference image processing, and paste-back workflows.☆30Aug 6, 2026Updated last week
- ☆11May 22, 2021Updated 5 years ago
- Community list of AI tools for audio and music☆20Aug 9, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆40Jul 13, 2026Updated last month
- CodeQL library and queries for iterator invalidation☆22Mar 12, 2026Updated 5 months ago
- Collections of multimodal search libraries, service and research papers☆17Apr 18, 2025Updated last year
- TraceTree - Runtime behavioral analysis tool that maps the process cascade of suspicious packages into a directed tree, catching supply c…☆42Jul 21, 2026Updated 3 weeks ago
- ☆20Jul 15, 2026Updated last month
- enseNova-U1: Unifying Multimodal Understanding and Generation with NEO-Unify Architecture☆79Aug 1, 2026Updated 2 weeks ago
- Repository for "Training Language Models To Explain Their Own Computations"☆34Jul 7, 2026Updated last month