October2001 / Awesome-KV-Cache-Compression
๐ฐ Must-read papers on KV Cache Compression (constantly updating ๐ค).
โ34Updated this week
Related projects: โ
- Awesome-LLM-KV-Cache: A curated list of ๐Awesome LLM KV Cache Papers with Codes.โ26Updated last month
- [ACL 2024] A Prospector of Long-Dependency Data for Large Language Modelsโ48Updated last month
- โ25Updated last month
- Multi-Candidate Speculative Decodingโ27Updated 4 months ago
- โ15Updated last week
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. ๐งฎโจโ72Updated 4 months ago
- Paper list and datasets for the paper: A Survey on Data Selection for LLM Instruction Tuningโ27Updated 7 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"โ54Updated 9 months ago
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**โ127Updated 3 months ago
- Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"โ61Updated 2 months ago
- The repo for In-context Autoencoderโ80Updated 4 months ago
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LAโฆโ30Updated 2 months ago
- โ110Updated last month
- โ17Updated 4 months ago
- โ23Updated 7 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsโ134Updated 2 months ago
- โ14Updated last year
- UniGen: A Unified Framework for Dataset Generation via Large Language Modelโ21Updated last week
- [SIGIR'24] The official implementation code of MOELoRA.โ113Updated last month
- โ46Updated 5 months ago
- Repository of LV-Eval Benchmarkโ41Updated 2 weeks ago
- [ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Modelsโ32Updated 2 months ago
- Dive-into-LLMs Tutorial for Beginnersโ6Updated 4 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningโ144Updated 7 months ago
- trending projects & awesome papers about data-centric llm studies.โ14Updated last month
- A tool for visualizing attention-score heatmap in generative LLMsโ13Updated 4 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..โ109Updated last week
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionsโ96Updated last week
- โ71Updated 8 months ago
- โ38Updated last week