⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”.
☆22Aug 13, 2026Updated 2 months ago
Alternatives and similar repositories for Massive-Activations-HLA
Users that are interested in Massive-Activations-HLA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators w…☆145Updated this week
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing (Technical Report)☆39Jul 10, 2026Updated 3 months ago
- Pipelined Self-Speculative Decoding for Looped Transformer☆20Sep 24, 2026Updated last month
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆16Jul 21, 2025Updated last year
- ☆25Jun 23, 2026Updated 4 months ago
- [ACL 2026] Official repo for "Native Hybrid Attention for Efficient Sequence Modeling"☆35Sep 17, 2026Updated last month
- Implementation of "Scaling Latent Reasoning via Looped Language Models" aka LoopLM☆31Apr 28, 2026Updated 5 months ago
- A repository to introduce the algorithmic information theory. You could learn what is Kolmogorov complexity and why it is important here.☆13Jul 23, 2025Updated last year
- ☆18Oct 2, 2026Updated 3 weeks ago
- Code and paper reproductions for MLPs Are Hebbians☆34Jul 22, 2026Updated 3 months ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 5 months ago
- A bilingual, continuously updated directory of AI agent cases, news, open-source projects, papers, and reusable resources.☆18Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆18Oct 15, 2026Updated last week
- The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".☆17Jan 4, 2026Updated 9 months ago
- Homepage for paper “MeKi : Memory-based Expert Knowledge Injection for Efficient LLM Scaling”☆30Mar 5, 2026Updated 7 months ago
- Dynamic Attention Mask (DAM) generate adaptive sparse attention masks per layer and head for Transformer models, enabling long-context in…☆14Jun 16, 2025Updated last year
- Official Project Page for Falcon: Fast Weight Attention for Continual Learning (https://arxiv.org/abs/2608.27763)☆41Oct 10, 2026Updated 2 weeks ago
- This repository contains the official implementation for the ECCV'22 paper, "SPIN: An Empirical Evaluation on Sharing Parameters of Isotr…☆20Sep 11, 2026Updated last month
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆20May 30, 2025Updated last year
- Towards Hardware and Software Continuous Integration☆13Jun 8, 2020Updated 6 years ago
- ☆120Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Jan 13, 2026Updated 9 months ago
- [ICML2026] Reproduce Kimi K1.5/K2 RL algorithm and rollout system☆21Apr 9, 2026Updated 6 months ago
- Text2SQL-Eval is a Text-to-SQL evaluating component for LLM trained on an open-source training dataset.☆15Jan 12, 2024Updated 2 years ago
- A curated paper list on On-Policy Distillation (OPD) & On-Policy Self-Distillation (OPSD) for LLMs — student rollouts + teacher feedback,…☆26Oct 10, 2026Updated 2 weeks ago
- Security-oriented three-axis observability for sandboxed AI agents: model intent, app context, and runtime telemetry into verifiable evid…☆61Updated this week
- tensorrt部署教程☆11Aug 1, 2025Updated last year
- Codebase for "Language Models that Play Chess and Explain their Moves"☆68Oct 5, 2026Updated 2 weeks ago
- ☆15Aug 26, 2024Updated 2 years ago
- [NeurIPS 2024 D&B Track] DACO: Towards Application-Driven and Comprehensive Data Analysis via Code Generation☆14Mar 5, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 中医药古籍文本，近700项☆15Feb 1, 2025Updated last year
- Unified MCP server — 41 sports API providers, 396 tools in one process: scores, stats, odds, esports, F1/MotoGP/NASCAR, EuroLeague, chess…☆40Oct 14, 2026Updated last week
- TACS: Taxonomy Adaptive Cross-Domain Semantic Segmentation☆12Jul 14, 2022Updated 4 years ago
- ☆14Sep 7, 2024Updated 2 years ago
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆24Apr 24, 2026Updated 6 months ago
- [ECCV 2024] Official Implementation of CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddings☆10Feb 24, 2025Updated last year
- [ICML 2026 Oral] Code for "Skip a Layer or Loop It? Learning Program-of-Layers in LLMs"☆47Sep 28, 2026Updated 3 weeks ago