Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
☆17May 24, 2024Updated 2 years ago
Alternatives and similar repositories for Cross-Layer-Attention
Users that are interested in Cross-Layer-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆21Sep 17, 2025Updated 9 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆41Oct 11, 2024Updated last year
- Source code for SWIFT, an efficient reward model.☆21Jan 13, 2026Updated 5 months ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated last year
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆36Dec 24, 2025Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 魔镜魔镜，无所不知的魔镜[-_-](并不是)☆13Jun 10, 2021Updated 5 years ago
- Official implementation of the WACV 2025 paper "3D Part Segmentation via Geometric Aggregation of 2D Visual Features"☆25Jun 8, 2025Updated last year
- [CVPR 2025] Decision SpikeFormer: Spike-Driven Transformer for Decision Making☆19Aug 8, 2025Updated 11 months ago
- [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs☆55Dec 7, 2025Updated 7 months ago
- “阿里灵杰”问天引擎电商搜索算法赛 13/2771☆10Jul 31, 2022Updated 3 years ago
- [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…☆16Feb 4, 2025Updated last year
- ☆20Sep 27, 2024Updated last year
- Can 3D Vision-Language Models Truly Understand Natural Language?☆20Mar 28, 2024Updated 2 years ago
- 🤔 When in Doubt: Improving Classification Performance with Alternating Normalization [Findings of EMNLP2021]☆15Oct 29, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11Nov 21, 2024Updated last year
- BitNet a4.8 Implementation in one file of pytorch☆22Jan 13, 2025Updated last year
- Hyperledger Indy/Sovrin/DID Comprehensive Architecture Reference Model (INDY ARM) - Draft document for discussion purposes☆14Jan 25, 2021Updated 5 years ago
- ☆10Feb 28, 2019Updated 7 years ago
- Research into appearance-based gaze estimation on mobile devices.☆14Jan 31, 2019Updated 7 years ago
- Contains hands-on example code for [O'reilly book "Deep Learning At Scale"](https://www.oreilly.com/library/view/deep-learning-at/9781098…☆31Jun 15, 2024Updated 2 years ago
- A custom Color Picker widget for PyQt5/PyQt6 applications.☆17May 22, 2021Updated 5 years ago
- Artificial Intelligence project☆10Mar 11, 2016Updated 10 years ago
- [CVPR 2025] Offical implementation of the paper "Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters The…☆31Mar 12, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 个人轨迹树 / My Previous Blog☆17Mar 14, 2020Updated 6 years ago
- LLaDA implementation☆19Jul 24, 2025Updated 11 months ago
- Code to reproduce experiments in Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows☆14May 23, 2024Updated 2 years ago
- VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model☆15Jul 31, 2025Updated 11 months ago
- ☆16May 31, 2023Updated 3 years ago
- 常常有人问，在大型项目上，Python是个烂语言吗？这本书回答了使用Python构建大型应用所需要的软件工程相关的知识，即如何使用lint，type hint, unit test, CI,git以及如何构建文档。☆13Jun 17, 2024Updated 2 years ago
- implement of NoProp-CT☆28May 2, 2025Updated last year
- In this repository I will be running various experiments on finetune different parts for xtts☆15Jun 22, 2024Updated 2 years ago
- [ECCV 2024] Make Your ViT-based Multi-view 3D Detectors Faster via Token Compression☆53Sep 21, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Paper reading: Jamba — Hybrid Transformer-Mamba LM (SSM → S4 → S6 → Jamba)☆15May 22, 2024Updated 2 years ago
- ☆20Nov 5, 2024Updated last year
- [TMLR 2022] Geometric Flow Network for 3D Point Cloud Semantic Segmentation☆42Jan 10, 2023Updated 3 years ago
- A content cache node unikernel☆12Sep 28, 2022Updated 3 years ago
- Graduate design project☆17Jun 29, 2015Updated 11 years ago
- Tensorflow implementation of ICLR2019 paper "Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistency"☆28Jul 4, 2020Updated 6 years ago
- The official code for paper "GPSToken: Gaussian Parameterized Spatially-adaptive Tokenization for Image Representation and Generation"☆58Apr 3, 2026Updated 3 months ago