Artifact for Oaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization
☆20May 9, 2025Updated last year
Alternatives and similar repositories for oaken
Users that are interested in oaken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆34Jul 4, 2024Updated 2 years ago
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.☆17Jan 29, 2026Updated 9 months ago
- Accelerator RTL inspired by VEGETA [HPCA'23] and MicroScopiQ [ISCA'25]☆17Nov 11, 2025Updated last year
- Matrix Accelerator Generator for GeMM Operations based on SIGMA Architecture in CHISEL HDL☆15Mar 21, 2024Updated 2 years ago
- Reimplementation of paper EIE by Stanford Song Han☆10Mar 18, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆27Apr 3, 2026Updated 7 months ago
- Artifact for "DX100: A Programmable Data Access Accelerator for Indirection (ISCA 2025)" paper☆22Nov 6, 2025Updated last year
- ☆42Oct 21, 2025Updated last year
- ☆12Jul 2, 2024Updated 2 years ago
- Open source RTL implementation of Tensor Core, Sparse Tensor Core, BitWave and SparSynergy in the article: "SparSynergy: Unlocking Flexib…☆27Aug 29, 2026Updated 2 months ago
- ☆171Jun 24, 2024Updated 2 years ago
- PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training☆23Jun 12, 2024Updated 2 years ago
- PiM simulation with Gem5 & Ramulator☆10Jun 23, 2023Updated 3 years ago
- ☆29Apr 15, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An accurate power model for high bandwidth memory (HBM) building on detailed power consumption characterization of 36 real HBM2 stacks. S…☆24Oct 14, 2026Updated last month
- ☆19Jan 11, 2026Updated 10 months ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated 2 years ago
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- HD-MoE: Hybrid and Dynamic Parallelism for Mixture-of-Expert LLMs with 3D Near-Memory Processing☆15Sep 2, 2026Updated 2 months ago
- A Full-System Framework for Simulating NDP devices from Caches to DRAM☆22Jan 12, 2024Updated 2 years ago
- A simulator for SK hynix AiM PIM architecture based on Ramulator 2.0☆74Jul 22, 2025Updated last year
- ☆300Oct 24, 2025Updated last year
- ☆11Nov 11, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆73Oct 14, 2025Updated last year
- mNPUsim: A Cycle-accurate Multi-core NPU Simulator (IISWC 2023)☆80Dec 29, 2025Updated 10 months ago
- [HPCA 2026 Best Paper Candidate] Official implementation of "Focus: A Streaming Concentration Architecture for Efficient Vision-Language …☆72Feb 8, 2026Updated 9 months ago
- ☆163Jul 19, 2025Updated last year
- Implementation of Microscaling data formats in SystemVerilog.☆35Nov 6, 2026Updated last week
- H2-LLM: Hardware-Dataflow Co-Exploration for Heterogeneous Hybrid-Bonding-based Low-Batch LLM Inference☆126Apr 26, 2025Updated last year
- ☆38Jul 27, 2026Updated 3 months ago
- ☆20Jun 1, 2023Updated 3 years ago
- DreamRAM: A Fine-Grained Configurable Design Space Modeling Tool for Custom 3D Die-Stacked DRAM☆26Sep 10, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- MICRO 2024 Evaluation Artifact for FuseMax☆19Aug 26, 2024Updated 2 years ago
- [ACM MM2025]: MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization☆45Aug 13, 2025Updated last year
- [CVPR 2025] HOT: Hadamard-based Optimized Training☆22Jul 1, 2026Updated 4 months ago
- FSA: Fusing FlashAttention within a Single Systolic Array☆210Apr 15, 2026Updated 6 months ago
- Cylon FAST '26 AE☆17Oct 10, 2026Updated last month
- ☆20Jun 4, 2026Updated 5 months ago
- PyTorchSim is a Comprehensive, Fast, and Accurate NPU Simulation Framework☆151Updated this week
Are these results useful?