Proof of concept: Exploiting temporal coherence in LLM inference-- delta encoding for KV cache compression and weight-skip prediction. Achieves F16-quality KV cache at Q4_0 compression ratios with zero perplexity loss on llama.cpp.
β51Apr 10, 2026Updated 6 months ago
Alternatives and similar repositories for delta-compress-llm
Users that are interested in delta-compress-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π ε°θ‘ζ―ζ₯θͺειΈθ‘ζ©ε¨δΊΊ β εΊζ¬ι’Γζθ‘ι’Γζ·ε²εζΈ¬οΌTelegram ζ¨ζοΌGitHub Actions ε θ²»θͺεθ·β124Sep 26, 2026Updated 3 weeks ago
- Per-app equalizer for Windows (Qt/C++, WASAPI loopback)β42Sep 26, 2026Updated 3 weeks ago
- Port of Facebook's LLaMA model in C/C++β22Aug 15, 2026Updated 2 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.β19Aug 30, 2024Updated 2 years ago
- Specialized AI agents for your bare metal. 100% On-Prem & Air-Gap ready.β25Feb 21, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open Source Routing Machine for OpenStreetMap API Lib and App for Nimβ10Jun 6, 2019Updated 7 years ago
- β18Jul 1, 2025Updated last year
- Debian packaging for NNCP [archived], moved to https://salsa.debian.org/go-team/packages/nncpβ14Feb 18, 2023Updated 3 years ago
- High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.β466Feb 22, 2026Updated 7 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.β64Jun 7, 2026Updated 4 months ago
- πππ Everything you need in order to get started building distributed machine learning with Apple's MLXβ23Aug 9, 2025Updated last year
- ISAAC PRNG implementation on Nimβ10Jul 15, 2026Updated 3 months ago
- Four ComfyUI nodes for MiniMax H3: name your media with @, lock exact dialogue, and get the structured brief H3 wants. No <Picture 1> booβ¦β36Aug 23, 2026Updated last month
- Build LLM systems you actually control. A free, open engineering book + course β from tokenization to serving your own models. Mechanismsβ¦β53Oct 3, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Async test/bench toolkit including single stepping executors. No-std compatible.β14Sep 19, 2021Updated 5 years ago
- Strix Halo (gfx1151) + XDNA2 NPU inference fork: Qwen3.8 Flash-Next UD-IQ4_XS with MTP. About 2,000 tok/s prefill (GPU + NPU, 2,013 at 8Kβ¦β48Updated this week
- β20Sep 28, 2024Updated 2 years ago
- Play any game ROM with associated emulator in RetroArch on Linuxβ18Jan 10, 2025Updated last year
- SMS Gateway for GoIPβ12May 14, 2022Updated 4 years ago
- Asynchronous downloads manager library for Nim.β12Jan 12, 2024Updated 2 years ago
- β13Jun 30, 2022Updated 4 years ago
- Agentic practices knowledge base + supporting software toolkitβ44Aug 14, 2026Updated 2 months ago
- cnccoder is a crate for writing cutting instructions and converting them to G-code for use on 3 axis CNC machinesβ11Apr 29, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β11Apr 17, 2012Updated 14 years ago
- β23Aug 9, 2024Updated 2 years ago
- ambianceβ70Jul 20, 2026Updated 2 months ago
- β11Apr 17, 2023Updated 3 years ago
- native Rust implementation of Kafka protocol and apiβ14Jun 13, 2023Updated 3 years ago
- A visionOS app to preview large scale models in real life (like housing plans!)β80Jul 29, 2026Updated 2 months ago
- LLM (v)RAM estimator for GGUF models from huggingface and ollama across various quantisation and context sizesβ13Nov 26, 2025Updated 10 months ago
- Python class for distributed video processing and encodingβ16Sep 4, 2021Updated 5 years ago
- Rust port of the streaming ddelta patch algorithm, based on bsdiffβ12May 2, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Open source, clear, transparent, real world llm benchmarksβ92Updated this week
- Open-Source, Local, Pricvacy focused, LLM data gathering tool for your own Digital Twinβ22Apr 30, 2026Updated 5 months ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with β¦β22Feb 15, 2026Updated 8 months ago
- A collection of Rust crates for working with the Kafka protocolβ10Aug 18, 2019Updated 7 years ago
- buck2 oci rulesβ13Jul 14, 2026Updated 3 months ago
- Synchronises Ableton Live to a live input such as microphone in the room or DJ playing recordβ11Aug 14, 2014Updated 12 years ago
- A common data structures for Inter-Blockchain Communication (IBC) messages that can be reused by different implementations or toolsβ15Apr 9, 2025Updated last year