KV cache compression via sparse coding
☆18Oct 26, 2025Updated last year
Alternatives and similar repositories for lexico
Users that are interested in lexico are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML2025] KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference☆32Jan 27, 2026Updated 9 months ago
- ☆14Aug 21, 2026Updated 2 months ago
- ☆16Nov 30, 2022Updated 3 years ago
- Unsupervised Grammar Induction with Combinatory Categorial Grammars☆10Jan 28, 2021Updated 5 years ago
- ☆10Mar 1, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Daily LLM inference optimization paper digest☆19Updated this week
- Probing for Labeled Dependency Trees (ACL 2022) + Sorting LMs by Structure (NAACL 2022)☆10Jun 11, 2024Updated 2 years ago
- code for paper Accurate KV Cache Quantization with Outlier Tokens Tracing (ACL2025 Main)☆11Jul 4, 2025Updated last year
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"☆66Oct 9, 2025Updated last year
- ☆17Feb 21, 2025Updated last year
- TDMS 2.0 support for F# and C#☆13Dec 26, 2022Updated 3 years ago
- ☆13Mar 28, 2025Updated last year
- Cross-model KV cache transfer in vLLM: a smaller model prefills, a bigger one answers from its cache (independent implementation of arXiv…☆19Aug 10, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14May 29, 2026Updated 5 months ago
- Complexity vs. Accuracy: On Mechanistic Interpretability's Dependence on the Linear Representation Hypothesis☆14Oct 9, 2025Updated last year
- ☆12May 15, 2025Updated last year
- A vibrant visualizer for Tenstorrent hardware written in Rust☆16Updated this week
- ☆11Mar 15, 2023Updated 3 years ago
- ☆19Jun 14, 2026Updated 4 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆14Mar 30, 2024Updated 2 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆162Dec 4, 2024Updated last year
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆70Feb 21, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆18Dec 2, 2024Updated last year
- ☆16Jun 4, 2024Updated 2 years ago
- Agentic Deep Graph Reasoning Implementation☆14Mar 4, 2025Updated last year
- [ICLR'26] SPRINT: Sparse-Dense Residual Fusion for Efficient Diffusion Transformers☆19Mar 19, 2026Updated 7 months ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 4 months ago
- My coding assignment for UIUC-CS441-Applied Machine Learning☆11Mar 24, 2022Updated 4 years ago
- Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"☆23Feb 6, 2025Updated last year
- Solution for problems in Applied Algorithm course☆18Mar 9, 2023Updated 3 years ago
- Work in progress.☆82Nov 25, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official Implementation (Pytorch) of the "Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation", EMNLP 2024 (main…☆12Mar 10, 2025Updated last year
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆78Jul 8, 2025Updated last year
- The tensor-network translation module for Qibo.☆16Updated this week
- ☆14Mar 20, 2026Updated 7 months ago
- Deep Learning for Healthcare☆12Jul 19, 2021Updated 5 years ago
- Instruction Following Eval☆18Jan 16, 2025Updated last year
- A collection of papers on awesome genome acceleration, e.g., architectures, systems, and algorithms.☆11Jun 9, 2026Updated 4 months ago