Official codebase for the MLSys 2026 paper "IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference". It enables high-fidelity and high-speed LLM/ViT deployment on ARM CPUs.
☆21May 29, 2026Updated 3 months ago
Alternatives and similar repositories for IntAttention
Users that are interested in IntAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Top-level repository of ACT Ecosystem☆28Jun 8, 2026Updated 3 months ago
- ☆19Mar 29, 2026Updated 5 months ago
- MobileFineTuner: Native C++ framework for fine-tuning LLMs directly on mobile devices. Features: LoRA/Full-FT, ZeRO-inspired parameter sh…☆23Sep 2, 2026Updated 2 weeks ago
- ☆20Apr 26, 2026Updated 4 months ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆36May 22, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Sep 29, 2021Updated 4 years ago
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆20May 20, 2026Updated 3 months ago
- ☆64Jul 21, 2024Updated 2 years ago
- scalable data movement in Exascale Supercomputers☆19Updated this week
- Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.☆22Apr 16, 2026Updated 5 months ago
- writing really fast kernels☆20Sep 12, 2026Updated last week
- DeDe (OSDI '25): an optimization framework for large-scale resource allocation☆15May 18, 2026Updated 4 months ago
- ☆11Aug 8, 2018Updated 8 years ago
- a minimal paged attention implementation☆21Jan 30, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Tempo is a system for declarative, efficient, end-to-end compiled dynamic deep learning☆31Oct 21, 2025Updated 10 months ago
- ☆43Oct 12, 2025Updated 11 months ago
- ☆56Dec 19, 2025Updated 9 months ago
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 6 months ago
- IntelliJ platform plugin for Wavefront OBJ format☆15Aug 16, 2026Updated last month
- Quantized Training for Convolutional Neural Networks using Xilinx Brevitas☆12Mar 16, 2022Updated 4 years ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆36Aug 14, 2026Updated last month
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated 2 months ago
- Artifact for Oaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization☆18May 9, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LLM-DSE: Searching Accelerator Parameters with LLM Agents☆18May 22, 2025Updated last year
- VECBEE: A Versatile Efficiency-Accuracy Configurable Batch Error Estimation Method for Greedy Approximate Logic Synthesis☆13Mar 8, 2022Updated 4 years ago
- Type-safe NBT parser with kotlinx.serialization, SNBT and JSON support.☆13Mar 4, 2023Updated 3 years ago
- ☆19Dec 21, 2020Updated 5 years ago
- Generate release notes based on GitHub Commits☆13Jun 25, 2022Updated 4 years ago
- ☆21Mar 3, 2025Updated last year
- Benchmarks for Approximate Circuit Synthesis☆17Aug 2, 2020Updated 6 years ago
- SLiM: One-shot Quantized Sparse Plus Low-rank Approximation of LLMs (ICML 2025)☆37Nov 28, 2025Updated 9 months ago
- C++ header-only reasoning library☆19Jul 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Jul 31, 2023Updated 3 years ago
- ☆73Mar 24, 2026Updated 5 months ago
- This project is a "source code cover" of the song "HelloWorld.java" by Nanowar of Steel... except it's now "HelloWorld.kt" and it's deliv…☆13Dec 3, 2024Updated last year
- Providing wrapper types for safely performing panic-free checked arithmetic on instants and durations.☆17Sep 1, 2026Updated 2 weeks ago
- Show inferred Python types as Inlay Hints using folds☆11Mar 3, 2025Updated last year
- vector accelerating unit☆37Dec 1, 2020Updated 5 years ago
- An alternative to OpenFaaS nats-queue-worker for long-running functions☆11Dec 14, 2022Updated 3 years ago