Linear Attention for Efficient Bidirectional Sequence Modeling
☆18May 13, 2025Updated last year
Alternatives and similar repositories for LION
Users that are interested in LION are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repo for NeurIPS 2025 poster: Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks☆17Jul 30, 2026Updated 2 months ago
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transi…☆18Oct 13, 2025Updated last year
- Code for Simpler Fast Vision Transformers with a Jumbo CLS Token☆13Feb 12, 2026Updated 8 months ago
- ☆16May 14, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Feb 2, 2026Updated 8 months ago
- [𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models☆21May 21, 2026Updated 5 months ago
- [NeurIPS 2024] Image Understanding Makes for A Good Tokenizer for Image Generation☆21Dec 17, 2024Updated last year
- On the Similarities of Embeddings in Contrastive Learning (ICML 2025)☆11Jul 15, 2025Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- Context-aware Biases for Length Extrapolation☆23May 24, 2025Updated last year
- A curated list of resources related to linear attention mechanisms.☆18Mar 16, 2025Updated last year
- Wisp: computer use for agents on macOS (accessibility tree + synthesized input + DevTools), with a CLI and MCP server☆19Sep 15, 2026Updated last month
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆20Jul 9, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆34Oct 22, 2024Updated 2 years ago
- Common types and interface for discretizers of ModelingToolkit PDESystems.☆14Oct 17, 2026Updated last week
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆29Feb 21, 2024Updated 2 years ago
- Code for the Avey-B paper (https://arxiv.org/abs/2602.15814)☆33Feb 21, 2026Updated 8 months ago
- ☆39Jul 16, 2026Updated 3 months ago
- EMNLP 2025 "LLMs are Better Than You Think: Label-Guided In-Context Learning for Named Entity Recognition"☆16Nov 4, 2025Updated 11 months ago
- Manuscript figures and panel data for the EVEE (Evo Variant Effect Explorer) paper☆21Oct 16, 2026Updated last week
- This is the repository for the project entitled "Revisiting K-mer Profile for Effective and Scalable Genome Representation Learning"☆11Oct 21, 2024Updated 2 years ago
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25…☆26Aug 31, 2026Updated last month
- ☆14Sep 20, 2026Updated last month
- We provide pytorch training scripts for enformer and borzoi☆10Jul 11, 2025Updated last year
- [AAAI 2026] SpikCommander: A High-performance Spiking Transformer with Multi-view Learning for Efficient Speech Command Recognition☆14Jan 19, 2026Updated 9 months ago
- GFMBench-API offers a unified middleware that decouples genomic foundation model architectures from diverse tasks, standardizes data stre…☆16Oct 15, 2026Updated 2 weeks ago
- Node Embedding from Neural Hamiltonian Orbits in Graph Neural Networks☆10Sep 8, 2023Updated 3 years ago
- ☆12May 18, 2024Updated 2 years ago
- ☆11Jun 24, 2024Updated 2 years ago
- Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)☆15May 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Mar 3, 2023Updated 3 years ago
- Codes for Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning☆11May 5, 2022Updated 4 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- Official Repository for ICML 2026 paper Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasone…☆14May 21, 2026Updated 5 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Oct 11, 2023Updated 3 years ago
- ☆10Oct 24, 2024Updated 2 years ago
- Attention variant with per-channel multiplicative decay☆50Jun 3, 2026Updated 4 months ago