Cranial-XIX / longhornLinks
Official PyTorch Implementation of the Longhorn Deep State Space Model
☆50Updated 6 months ago
Alternatives and similar repositories for longhorn
Users that are interested in longhorn are comparing it to the libraries listed below
Sorting:
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- Stick-breaking attention☆56Updated 2 months ago
- ☆65Updated 11 months ago
- ☆46Updated last year
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆64Updated last year
- ☆31Updated 7 months ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆104Updated 3 weeks ago
- ☆29Updated 6 months ago
- Official Code Repository for the paper "Continuous Diffusion Model for Language Modeling".☆29Updated 2 months ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆37Updated 2 years ago
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆26Updated 8 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆36Updated last week
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated 9 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆16Updated last month
- ☆85Updated last year
- Reinforcement Learning via Regressing Relative Rewards☆32Updated 5 months ago
- Official repository for "RLVR-World: Training World Models with Reinforcement Learning", https://arxiv.org/abs/2505.13934☆36Updated this week
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆40Updated 3 weeks ago
- ☆31Updated last year
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆25Updated last month
- Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…☆108Updated 8 months ago
- ☆54Updated 10 months ago
- Official code for the paper "Attention as a Hypernetwork"☆36Updated 11 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆60Updated 3 months ago
- Experiments on the impact of depth in transformers and SSMs.☆30Updated 7 months ago
- ☆52Updated last year
- Minimal but scalable implementation of large language models in JAX☆34Updated 7 months ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆21Updated 2 months ago
- ☆19Updated 3 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆81Updated 3 weeks ago