Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
☆17May 24, 2024Updated last year
Alternatives and similar repositories for Cross-Layer-Attention
Users that are interested in Cross-Layer-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.☆13Sep 2, 2024Updated last year
- Computer programming - ShanghaiTech☆12Jan 10, 2020Updated 6 years ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆41Oct 11, 2024Updated last year
- dynamic planning, hybrid models, hierarchical active inference, tool use☆15Jun 13, 2025Updated 10 months ago
- Official implementation of the WACV 2025 paper "3D Part Segmentation via Geometric Aggregation of 2D Visual Features"☆25Jun 8, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [CVPR 2025] Decision SpikeFormer: Spike-Driven Transformer for Decision Making☆19Aug 8, 2025Updated 9 months ago
- [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs☆56Dec 7, 2025Updated 5 months ago
- [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…☆16Feb 4, 2025Updated last year
- This repository contains an experimental PyTorch implementation exploring the NoProp algorithm, presented in the paper "NOPROP: TRAINING …☆16Apr 19, 2026Updated 2 weeks ago
- ☆20Sep 27, 2024Updated last year
- Generative Modeling via Drifting in MLX☆43Feb 6, 2026Updated 3 months ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆20Mar 28, 2024Updated 2 years ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆71Jul 30, 2024Updated last year
- 🤔 When in Doubt: Improving Classification Performance with Alternating Normalization [Findings of EMNLP2021]☆14Oct 29, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Apr 5, 2022Updated 4 years ago
- ☆11Nov 21, 2024Updated last year
- BitNet a4.8 Implementation in one file of pytorch☆21Jan 13, 2025Updated last year
- Research into appearance-based gaze estimation on mobile devices.☆14Jan 31, 2019Updated 7 years ago
- CS 251: Cryptocurrencies and blockchain technologies (homework + projects)☆24Jul 19, 2023Updated 2 years ago
- A collection of annotation tools for LiDAR Point Cloud. There are 3D Object Detection directions, and Semantic Segmentation.☆38Oct 15, 2023Updated 2 years ago
- 回声Echo：AI文案助手☆10May 6, 2023Updated 3 years ago
- Code for "Learning Canonical Representations for Scene Graph to Image Generation", Herzig & Bar et al., ECCV2020☆30Nov 22, 2022Updated 3 years ago
- Multi-span Style Extraction for Generative Reading Comprehension☆10Apr 2, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- UC Berkeley CS188 & ShanghaiTech CS181: Projects, Homework, Notes☆23Jun 16, 2022Updated 3 years ago
- [CVPR 2025] Offical implementation of the paper "Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters The…☆32Mar 12, 2026Updated last month
- LLaDA implementation☆19Jul 24, 2025Updated 9 months ago
- VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model☆15Jul 31, 2025Updated 9 months ago
- ☆16May 31, 2023Updated 2 years ago
- pytorch implementation of mvp: a multi-stage vision-language pre-training framework☆11Apr 23, 2022Updated 4 years ago
- [ECCV 2024] Make Your ViT-based Multi-view 3D Detectors Faster via Token Compression☆53Sep 21, 2024Updated last year
- Paper reading: Jamba — Hybrid Transformer-Mamba LM (SSM → S4 → S6 → Jamba)☆15May 22, 2024Updated last year
- ☆19Nov 5, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [TMLR 2022] Geometric Flow Network for 3D Point Cloud Semantic Segmentation☆42Jan 10, 2023Updated 3 years ago
- 基于cnn的视频动作分类教程。☆11Aug 17, 2020Updated 5 years ago
- ☆16Oct 13, 2020Updated 5 years ago
- Tensorflow implementation of ICLR2019 paper "Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistency"☆28Jul 4, 2020Updated 5 years ago
- [CVPR 2024] The official implementation of paper "Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training"☆35Apr 21, 2024Updated 2 years ago
- Gaussian Splating 2d implemented in triton☆12Mar 19, 2024Updated 2 years ago
- The OBMO module embedded in PatchNet☆10Feb 21, 2024Updated 2 years ago