Alternatives and similar repositories for RWKV-v2-RNN-Pile:

Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below

• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆64Updated last year
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆145Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 3 years ago
• BlinkDL / WorldModel
  Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…
  ☆40Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• zphang / minimal-gpt-neox-20b
  ☆128Updated 2 years ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆59Updated 3 years ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆130Updated 10 months ago
• zphang / minimal-opt
  ☆67Updated 2 years ago
• basusourya / mirostat
  Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).
  ☆58Updated 3 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆51Updated 11 months ago
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆48Updated last year
• davisyoshida / easy-lora-and-gptq
  JAX notebook showing how to LoRA + GPTQ arbitrary models
  ☆10Updated last year
• crowsonkb / cloob-training
  CLOOB training (JAX) and inference (JAX and PyTorch)
  ☆70Updated 2 years ago
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆208Updated 6 months ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated last year
• deep-spin / infinite-former
  ☆64Updated 6 months ago