RWKV model implementation
☆37Jul 15, 2023Updated 2 years ago
Alternatives and similar repositories for rwkv
Users that are interested in rwkv are comparing it to the libraries listed below
Sorting:
- ☆27Updated this week
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- ☆33Oct 4, 2024Updated last year
- Code for the paper "Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning"☆11May 5, 2021Updated 4 years ago
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 2 years ago
- Recursive Bayesian Networks☆11May 11, 2025Updated 9 months ago
- ☆14Feb 1, 2024Updated 2 years ago
- Lean formalization of aperiodic monotiles papers (staging repository for material not yet in mathlib)☆15Feb 18, 2026Updated 2 weeks ago
- Implementations of various linear RNN layers using pytorch and triton☆54Aug 4, 2023Updated 2 years ago
- Easy trees in LaTeX and TikZ☆14Dec 16, 2022Updated 3 years ago
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 2 years ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆138Apr 30, 2024Updated last year
- X (weighted / probabilistic) Context-Free Grammars☆25Jan 30, 2024Updated 2 years ago
- A sample pattern for running CI tests on Modal☆19Apr 12, 2025Updated 10 months ago
- Formalization of Gröbner basis theory in Lean4 (WIP)☆31Feb 14, 2026Updated 2 weeks ago
- Implementation of fast algorithms for Maximum Spanning Tree (MST) parsing that includes fast ArcMax+Reweighting+Tarjan algorithm for sing…☆16Aug 9, 2023Updated 2 years ago
- Code for the paper "The Surprising Computational Power of Nondeterministic Stack RNNs" (DuSell and Chiang, 2023)☆19Mar 21, 2024Updated last year
- Python wrapper for the DPMMSubClusterStreaming.jl Julia package.☆14Sep 9, 2022Updated 3 years ago
- Author implementation of the paper "Span-based Semantic Parsing for Compositional Generalization"☆17Aug 29, 2021Updated 4 years ago
- Example formalization of Game Theoretic concepts in Lean☆26Feb 14, 2025Updated last year
- Reading list for research topics in Diffusion models.☆18Jan 12, 2024Updated 2 years ago
- ☆19Dec 4, 2025Updated 3 months ago
- Openwater's Open-Source Neuromodulation Hardware☆22Mar 9, 2024Updated last year
- ☆20Nov 25, 2020Updated 5 years ago
- Official Repository for Efficient Linear-Time Attention Transformers.☆18Jun 2, 2024Updated last year
- Easily deploy your rwkv model☆19May 5, 2023Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Jun 21, 2023Updated 2 years ago
- ☆51Jan 28, 2024Updated 2 years ago
- JAX implementations of RWKV☆19Sep 26, 2023Updated 2 years ago
- A public repository for our paper, Rao-Blackwellized Stochastic Gradients for Discrete Distributions☆22May 5, 2019Updated 6 years ago
- ☆22Oct 26, 2020Updated 5 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- ☆21Oct 29, 2023Updated 2 years ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Apr 20, 2024Updated last year
- Code repository for the c-BTM paper☆108Sep 26, 2023Updated 2 years ago
- Official PyTorch (Lightning) implementation of the NeurIPS 2020 paper "Efficient Marginalization of Discrete and Structured Latent Variab…☆27May 3, 2021Updated 4 years ago
- Neurosity EEG Dataset repository☆29Apr 8, 2024Updated last year
- Download images and convert it to pdf (NSFW: A+)☆14Mar 29, 2025Updated 11 months ago
- Command-line script for inferencing from models such as LLaMA, in a chat scenario, with LoRA adaptations☆33Jun 1, 2023Updated 2 years ago