Cranial-XIX / longhorn
Official PyTorch Implementation of the Longhorn Deep State Space Model
☆50Updated 5 months ago
Alternatives and similar repositories for longhorn
Users that are interested in longhorn are comparing it to the libraries listed below
Sorting:
- Stick-breaking attention☆53Updated 2 months ago
- ☆47Updated last year
- ☆64Updated 11 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- ☆31Updated last year
- Official code for the paper "Attention as a Hypernetwork"☆33Updated 10 months ago
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆99Updated last month
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆64Updated last year
- ☆30Updated 5 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated 8 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆54Updated 3 months ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆36Updated 2 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆43Updated last year
- ☆31Updated 6 months ago
- ☆85Updated last year
- ☆53Updated 10 months ago
- ☆78Updated 8 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆63Updated last month
- ☆52Updated 11 months ago
- ☆19Updated 2 months ago
- ☆31Updated 3 months ago
- DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)☆27Updated last month
- ☆51Updated 11 months ago
- ICML 2022: Learning Iterative Reasoning through Energy Minimization☆46Updated 2 years ago
- ☆32Updated 5 months ago
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆26Updated 8 months ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆29Updated 10 months ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆22Updated last week
- implementation of dualformer☆17Updated 2 months ago
- JAX reimplementation of the DeepMind paper "Genie: Generative Interactive Environments"☆62Updated 3 months ago