PyTorch implementation of RWKV blocks
☆32Jul 22, 2025Updated 7 months ago
Alternatives and similar repositories for RWKV-block
Users that are interested in RWKV-block are comparing it to the libraries listed below
Sorting:
- ☆27Feb 26, 2026Updated last week
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆54Jan 12, 2026Updated last month
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆65Dec 15, 2025Updated 2 months ago
- ☆11Oct 11, 2023Updated 2 years ago
- Experiments on the impact of depth in transformers and SSMs.☆40Oct 23, 2025Updated 4 months ago
- RWKV-7 mini☆12Mar 29, 2025Updated 11 months ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 2 years ago
- ☆16Apr 14, 2025Updated 10 months ago
- ☆17Dec 19, 2024Updated last year
- Conway is a high-performance IFC&STEP engine for web-based CAD applications☆21Dec 4, 2025Updated 3 months ago
- ☆20Mar 2, 2025Updated last year
- ☆20May 30, 2024Updated last year
- AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)☆23Oct 15, 2024Updated last year
- ☆19Dec 4, 2025Updated 3 months ago
- ☆23Dec 28, 2024Updated last year
- ☆22Dec 15, 2023Updated 2 years ago
- RADLADS training code☆37May 7, 2025Updated 9 months ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆54Dec 23, 2024Updated last year
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- [NeurIPS 2024] Repository for the paper "OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking".☆27Nov 9, 2024Updated last year
- Checkpointable dataset utilities for foundation model training☆32Jan 29, 2024Updated 2 years ago
- ☆29Jul 9, 2024Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆30Jan 28, 2026Updated last month
- ☆50Jun 16, 2025Updated 8 months ago
- An annotated implementation of the Hyena Hierarchy paper☆34May 28, 2023Updated 2 years ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Jul 30, 2020Updated 5 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆33Aug 14, 2024Updated last year
- Fast modular code to create and train cutting edge LLMs☆68May 16, 2024Updated last year
- 🏄 [ICLR 2025] OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformer☆88Aug 4, 2025Updated 7 months ago
- Official Implementation of APB (ACL 2025 main Oral) and Spava.☆34Jan 30, 2026Updated last month
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆75Aug 2, 2024Updated last year
- Chrome extension that restores the Dim (dark blue) background theme on X/Twitter☆36Feb 26, 2026Updated last week
- Official code repository of the paper Learning Associative Inference Using Fast Weight Memory by Schlag et al.☆29Feb 25, 2021Updated 5 years ago
- Forked from https://gitlab.com/MatejB/PrePoMax☆13Jan 8, 2024Updated 2 years ago
- Awesome Triton Resources☆39Apr 27, 2025Updated 10 months ago
- ☆32May 26, 2024Updated last year
- Sequence Modeling with Structured State Spaces☆67Aug 2, 2022Updated 3 years ago