Alternatives and similar repositories for RWKV-v2-RNN-Pile:

Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below

• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆64Updated last year
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated 2 years ago
• BlinkDL / WorldModel
  Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…
  ☆40Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated last year
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 3 years ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• zphang / minimal-gpt-neox-20b
  ☆129Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• zphang / minimal-opt
  ☆66Updated 2 years ago
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆210Updated 7 months ago
• crowsonkb / cloob-training
  CLOOB training (JAX) and inference (JAX and PyTorch)
  ☆71Updated 2 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆37Updated 2 years ago
• nostalgebraist / improved-diffusion
  Text-writing denoising diffusion (and much more)
  ☆30Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆80Updated 3 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆131Updated 11 months ago
• bjoernpl / KOSMOS_reimplementation
  A reimplementation of KOSMOS-1 from "Language Is Not All You Need: Aligning Perception with Language Models"
  ☆27Updated 2 years ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 8 months ago
• patil-suraj / stable-diffusion-jax
  ☆88Updated 2 years ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• euclaise / supertrainer2000
  ☆49Updated last year
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• deep-spin / infinite-former
  ☆64Updated 7 months ago
• JD-P / cloob-latent-diffusion
  CLOOB Conditioned Latent Diffusion training and inference code
  ☆112Updated 2 years ago