⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”.
☆25Aug 13, 2026Updated 3 months ago
Alternatives and similar repositories for Massive-Activations-HLA
Users that are interested in Massive-Activations-HLA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡ Official code for “ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models…☆17Oct 15, 2026Updated 3 weeks ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- ☆19May 16, 2026Updated 5 months ago
- Depth-Attention: Cross-Layer Value Mixing for Language Models☆11Aug 7, 2026Updated 3 months ago
- Code for the paper Depth Memory☆17Oct 14, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Mixture-Density-Object-Detector: PyTorch Implementation☆11Jun 3, 2021Updated 5 years ago
- Official PyTorch implementation of Cyclic Flow Attention (CyFA)☆17Oct 17, 2026Updated 3 weeks ago
- ☆16Jul 21, 2025Updated last year
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated 2 months ago
- ☆19Oct 11, 2026Updated last month
- A repository to introduce the algorithmic information theory. You could learn what is Kolmogorov complexity and why it is important here.☆13Jul 23, 2025Updated last year
- [ICML 2025] Official code for the paper "RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models…☆10May 29, 2025Updated last year
- ☆18Oct 2, 2026Updated last month
- chinese-laya☆17Oct 13, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Homepage for paper “MeKi : Memory-based Expert Knowledge Injection for Efficient LLM Scaling”☆30Mar 5, 2026Updated 8 months ago
- The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".☆17Jan 4, 2026Updated 10 months ago
- (Nanochat based) Full-bandwidth transformer, feed LLM's own deep hidden states back to itself☆20Oct 3, 2026Updated last month
- This repository contains the official implementation for the ECCV'22 paper, "SPIN: An Empirical Evaluation on Sharing Parameters of Isotr…☆20Sep 11, 2026Updated 2 months ago
- FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates☆26Sep 28, 2026Updated last month
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆20May 30, 2025Updated last year
- Text2SQL-Eval is a Text-to-SQL evaluating component for LLM trained on an open-source training dataset.☆15Jan 12, 2024Updated 2 years ago
- [ICML2026] Reproduce Kimi K1.5/K2 RL algorithm and rollout system☆22Apr 9, 2026Updated 7 months ago
- Pipelined Self-Speculative Decoding for Looped Transformer☆24Sep 24, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A simple proof of concept for WinRAR Path Traversal | RCE | CVE-2025-6218☆12Jun 29, 2025Updated last year
- DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators w…☆154Oct 21, 2026Updated 3 weeks ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 6 months ago
- tensorrt部署教程☆11Aug 1, 2025Updated last year
- Code and paper reproductions for MLPs Are Hebbians☆34Jul 22, 2026Updated 3 months ago
- Towards Hardware and Software Continuous Integration☆13Jun 8, 2020Updated 6 years ago
- Repo for ACL 2024 paper "Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents"☆13Jun 6, 2024Updated 2 years ago
- [NeurIPS 2024 D&B Track] DACO: Towards Application-Driven and Comprehensive Data Analysis via Code Generation☆14Mar 5, 2025Updated last year
- Hyperspherical Contrastive Representations Unlock Planning and Exploration☆18Nov 5, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ECCV 2024] Official Implementation of CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddings☆10Feb 24, 2025Updated last year
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆24Apr 24, 2026Updated 6 months ago
- [ACL 2026] Official repo for "Native Hybrid Attention for Efficient Sequence Modeling"☆36Sep 17, 2026Updated last month
- ☆14Jan 13, 2026Updated 10 months ago
- TACS: Taxonomy Adaptive Cross-Domain Semantic Segmentation☆12Jul 14, 2022Updated 4 years ago
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 4 months ago
- evals.typesafe.ai workflow code published☆21Updated this week
Are these results useful?