Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
☆361May 21, 2025Updated last year
Alternatives and similar repositories for KVSplit
Users that are interested in KVSplit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Merliot Device Hub☆165Jun 11, 2025Updated last year
- Fully neural approach for text chunking☆415Oct 23, 2025Updated 8 months ago
- Artificial Neural Engine Machine Learning Library☆1,625Mar 10, 2026Updated 3 months ago
- Docker-based inference engine for AMD GPUs☆234Oct 7, 2024Updated last year
- A simple alternative to homebrew for installing binary packages on MacOS & Linux written in Go.☆224Apr 29, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆346Oct 24, 2025Updated 8 months ago
- Erlang interpreter for Node-RED (visual flow based programming) with Elixir support☆336Apr 3, 2026Updated 3 months ago
- ☆198May 5, 2025Updated last year
- A powerful document AI question-answering tool that connects to your local Ollama models. Create, manage, and interact with RAG systems f…☆1,094Aug 9, 2025Updated 10 months ago
- World's first Nintendo 3DS emulator for Apple devices based on Citra.☆18Apr 7, 2023Updated 3 years ago
- High-Performance Implementation of OpenAI's TikToken.☆476Jul 3, 2025Updated last year
- https://ollama.com/search?o=newest☆34Updated this week
- Min.js Style Compression of Tech Docs for LLM Context☆678Oct 5, 2025Updated 9 months ago
- Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams)☆680May 13, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Rust Implementation of Model2Vec☆197May 24, 2026Updated last month
- Rewriting Principia Mathematica in Lean☆137Feb 5, 2026Updated 5 months ago
- Open-source VMs-as-a-service☆776May 29, 2026Updated last month
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆630Feb 24, 2025Updated last year
- High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and in…☆1,289Jun 20, 2026Updated 2 weeks ago
- Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full…☆19,343Updated this week
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆125Apr 21, 2025Updated last year
- LLM plugin for pulling content from Hacker News☆130May 5, 2025Updated last year
- Resource (icon) extraction tools☆13Apr 22, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Transductive regular expressions☆257Sep 25, 2025Updated 9 months ago
- VPN over UDP☆114Feb 3, 2026Updated 5 months ago
- Server for Matching Long/Lat to Timezone☆47Feb 21, 2026Updated 4 months ago
- A new wide-spectrum content blocker for Safari.☆361Jun 26, 2026Updated last week
- A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your …☆3,281May 24, 2026Updated last month
- ☆1,316Aug 21, 2025Updated 10 months ago
- ☆127May 17, 2026Updated last month
- Render source code in 3D, for macOS and iOS.☆198Dec 1, 2024Updated last year
- A cache for AI agents to learn and replay complex behaviors.☆762Jun 15, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a small, lightweight crate for numerical integration written in Rust.☆117May 10, 2026Updated last month
- MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.☆3,160Jul 7, 2025Updated 11 months ago
- a concurrent hash array mapped trie implementation in go☆58Jun 19, 2025Updated last year
- ☆10Apr 1, 2025Updated last year
- ☆270Aug 22, 2025Updated 10 months ago
- ☆13Feb 24, 2026Updated 4 months ago
- Rust based package manager for macOS☆1,838Sep 2, 2025Updated 10 months ago