bojone / rnn
一些RNN的实现
☆48Updated last year
Related projects ⓘ
Alternatives and complementary repositories for rnn
- 基于Gated Attention Unit的Transformer模型（尝鲜版）☆97Updated last year
- ☆25Updated 4 months ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆61Updated 7 months ago
- A Tight-fisted Optimizer☆47Updated last year
- Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)☆31Updated 3 years ago
- 逻辑回归和单层softmax的解析解☆12Updated 3 years ago
- Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)☆83Updated 2 years ago
- A pytorch &keras implementation and demo of Fastformer.☆187Updated 2 years ago
- FLASHQuad_pytorch☆66Updated 2 years ago
- 基于Transformer的单模型、多尺度的VAE模型☆53Updated 3 years ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆50Updated last week
- A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆107Updated 3 years ago
- dpo算法实现☆17Updated 5 months ago
- Python下shuffle几百G文件☆33Updated 3 years ago
- code for Explicit Sparse Transformer☆56Updated last year
- ☆49Updated last year
- GAU-alpha-pytorch☆19Updated 2 years ago
- [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer☆55Updated last year
- [EMNLP'19] Summary for Transformer Understanding☆52Updated 4 years ago
- Learning to Encode Position for Transformer with Continuous Dynamical Model☆59Updated 4 years ago
- This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…☆29Updated 2 years ago
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆115Updated 8 months ago
- RoFormer升级版☆149Updated 2 years ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆74Updated 7 months ago
- 记录Transformer升级的论文笔记☆18Updated last year
- tinybig for deep function learning☆36Updated this week
- ICLR2023 - Tailoring Language Generation Models under Total Variation Distance☆21Updated last year
- ☆31Updated 2 years ago
- ☆65Updated 2 months ago
- ☆15Updated 10 months ago