Alternatives and similar repositories for BlackGoose_Rimer:

Users that are interested in BlackGoose_Rimer are comparing it to the libraries listed below

• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated last month
• yynil / RWKVInside
  ☆32Updated last week
• OpenMOSE / RWKV-Infer
  A large-scale RWKV v6, v7(World, ARWKV, PRWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy o…
  ☆33Updated last week
• TorchRWKV / flash-linear-attention
  Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
  ☆21Updated this week
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆35Updated last week
• JL-er / WorldRWKV
  ☆40Updated this week
• TorchRWKV / rwkv-kit
  ☆22Updated 3 months ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆35Updated last month
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 5 months ago
• Jellyfish042 / RWKV_Othello
  A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…
  ☆39Updated 2 months ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 3 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆24Updated 8 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 8 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 7 months ago
• TsinghuaC3I / Fourier-Position-Embedding
  Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆14Updated 2 months ago
• lucidrains / deep-cross-attention
  Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch
  ☆81Updated last month
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆53Updated 7 months ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆28Updated 2 weeks ago
• AI-S2-Lab / EmoPP
  [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech
  ☆22Updated 7 months ago
• Yuan-ManX / Titans-PyTorch
  PyTorch implementation of Titans.
  ☆21Updated 2 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 6 months ago
• JL-er / DiSHA
  ☆12Updated 3 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆44Updated last month
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆33Updated last month
• BBuf / RWKV-World-HF-Tokenizer
  ☆34Updated 8 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 7 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated 11 months ago
• Jellyfish042 / RWKV-StateTuning
  State tuning tunes the state
  ☆31Updated last month
• gmongaras / Cottention_Transformer
  Code for the paper "Cottention: Linear Transformers With Cosine Attention"
  ☆15Updated 5 months ago