Linear Attention for Efficient Bidirectional Sequence Modeling
☆18May 13, 2025Updated last year
Alternatives and similar repositories for LION
Users that are interested in LION are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2024] Representation Deficiency in Masked Language Modeling☆11Mar 15, 2024Updated 2 years ago
- Official repo for NeurIPS 2025 poster: Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks☆17Jul 30, 2026Updated 3 months ago
- DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transi…☆19Oct 13, 2025Updated last year
- Code for Simpler Fast Vision Transformers with a Jumbo CLS Token☆13Feb 12, 2026Updated 9 months ago
- ☆16May 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models☆22May 21, 2026Updated 5 months ago
- [NeurIPS 2024] Image Understanding Makes for A Good Tokenizer for Image Generation☆21Dec 17, 2024Updated last year
- MultiscaleGraphSignalTransforms.jl is a collection of software tools written in the Julia programming language for graph signal processin…☆12Mar 15, 2026Updated 8 months ago
- A curated list of resources related to linear attention mechanisms.☆19Mar 16, 2025Updated last year
- Context-aware Biases for Length Extrapolation☆22May 24, 2025Updated last year
- ☆34Oct 22, 2024Updated 2 years ago
- Common types and interface for discretizers of ModelingToolkit PDESystems.☆14Oct 30, 2026Updated 2 weeks ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆30Apr 17, 2024Updated 2 years ago
- Code for the Avey-B paper (https://arxiv.org/abs/2602.15814)☆33Feb 21, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This project contains code for the paper titled "SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentia…☆29Feb 21, 2024Updated 2 years ago
- Wisp: computer use for agents on macOS (accessibility tree + synthesized input + DevTools), with a CLI and MCP server☆20Sep 15, 2026Updated 2 months ago
- This is the repository for the project entitled "Revisiting K-mer Profile for Effective and Scalable Genome Representation Learning"☆11Oct 21, 2024Updated 2 years ago
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25…☆26Aug 31, 2026Updated 2 months ago
- Flutter + Codemirror☆12Apr 3, 2021Updated 5 years ago
- We provide pytorch training scripts for enformer and borzoi☆10Jul 11, 2025Updated last year
- Node Embedding from Neural Hamiltonian Orbits in Graph Neural Networks☆10Sep 8, 2023Updated 3 years ago
- Source Code for AVE Speech Dataset☆13Aug 28, 2025Updated last year
- Kolmogorov-Arnold networks (KAN) as implicit functions (like NeRF but simpler)☆15May 16, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Jun 24, 2024Updated 2 years ago
- Genomic Tokenizer: Biology-driven Tokenizer for DNA sequences☆14Updated this week
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- A benchmark suite of five genomics tasks for evaluating DNA foundation models on long-range dependencies.☆15Oct 6, 2026Updated last month
- GFMBench-API offers a unified middleware that decouples genomic foundation model architectures from diverse tasks, standardizes data stre…☆17Oct 15, 2026Updated last month
- Equivariant layers for RC-complement symmetry in DNA sequence data☆13Feb 24, 2022Updated 4 years ago
- Model-Order Reduction Framework for Nek5000☆16Sep 30, 2026Updated last month
- ☆10Oct 24, 2024Updated 2 years ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Oct 11, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Attention variant with per-channel multiplicative decay☆50Jun 3, 2026Updated 5 months ago
- KGANCDA is effective to predict associations between circRNA and cancer, which is based on knowledge graph attention network. The detail …☆13Dec 12, 2022Updated 3 years ago
- Cuda implemenation of flash-kmeans, 2x faster☆23May 8, 2026Updated 6 months ago
- Source code of ProDMM. The paper is titled with "Unveiling Protein-DNA Interdependency: Harnessing Unified Multimodal Sequence Modeling, …☆10Oct 12, 2026Updated last month
- ☆15Aug 20, 2026Updated 2 months ago
- Official code for "There is no SAMantics! Exploring SAM as a Backbone for Visual Understanding Tasks"☆11Jul 5, 2025Updated last year
- ☆14Nov 4, 2026Updated 2 weeks ago
Are these results useful?