Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
☆362May 21, 2025Updated last year
Alternatives and similar repositories for KVSplit
Users that are interested in KVSplit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Merliot Device Hub☆165Jun 11, 2025Updated last year
- Fully neural approach for text chunking☆421Oct 23, 2025Updated 11 months ago
- A simple alternative to homebrew for installing binary packages on MacOS & Linux written in Go.☆223Apr 29, 2026Updated 4 months ago
- Docker-based inference engine for AMD GPUs☆234Oct 7, 2024Updated last year
- Erlang interpreter for Node-RED (visual flow based programming) with Elixir support☆334Apr 3, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Artificial Neural Engine Machine Learning Library☆1,677Updated this week
- High-Performance Implementation of OpenAI's TikToken.☆475Jul 3, 2025Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆348Oct 24, 2025Updated 11 months ago
- Min.js Style Compression of Tech Docs for LLM Context☆672Oct 5, 2025Updated 11 months ago
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems f…☆1,094Aug 9, 2025Updated last year
- ☆197May 5, 2025Updated last year
- https://ollama.com/search?o=newest☆35Updated this week
- Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams)☆675May 13, 2026Updated 4 months ago
- Rewriting Principia Mathematica in Lean☆141Feb 5, 2026Updated 7 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- AI Dataset Generator – Create realistic datasets for demos, learning, and dashboards☆766Oct 3, 2025Updated 11 months ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Apr 21, 2025Updated last year
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆629Feb 24, 2025Updated last year
- This repo contains a new way to use bloom filters to do lossless video compression☆249Jun 5, 2025Updated last year
- LLM plugin for pulling content from Hacker News☆129May 5, 2025Updated last year
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and in…☆1,303Updated this week
- Don't Simply Trust MCP Server Code, Validate and Scan☆97Aug 19, 2025Updated last year
- Transductive regular expressions☆258Sep 4, 2026Updated 2 weeks ago
- Open-source VMs-as-a-service☆800Aug 30, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Server for Matching Long/Lat to Timezone☆47Feb 21, 2026Updated 7 months ago
- a small, lightweight crate for numerical integration written in Rust.☆115May 10, 2026Updated 4 months ago
- A new wide-spectrum content blocker for Safari.☆356Jun 26, 2026Updated 2 months ago
- Snap-Scope: Analyze Your Lens Focal Length Distribution 📸✨☆21Jul 15, 2025Updated last year
- A reimplementation of Stable Diffusion 3.5 in pure PyTorch☆708Jun 14, 2025Updated last year
- A way to remotely switch Steam users using HomeKit☆40Jun 28, 2026Updated 2 months ago
- ☆136Aug 11, 2025Updated last year
- VPN over UDP☆112Feb 3, 2026Updated 7 months ago
- A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your …☆3,315May 24, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A cache for AI agents to learn and replay complex behaviors.☆765Jun 15, 2025Updated last year
- The open-source alternative to Claude Managed Agents☆2,863Updated this week
- ☆1,314Aug 21, 2025Updated last year
- airplay to an ios device☆408Updated this week
- LLM plugin for embeddings using sentence-transformers☆74Apr 23, 2025Updated last year
- A structural code search engine for Al agents.☆557Jul 13, 2026Updated 2 months ago
- ✨ A fast, cross-platform CLI tool to check the git status of multiple projects organized by categories.☆113Jun 8, 2026Updated 3 months ago