Alternatives and similar repositories for tinyrwkv:

Users that are interested in tinyrwkv are comparing it to the libraries listed below

• ArEnSc / Production-RWKV
  This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…
  ☆64Updated last year
• lachlansneff / sparsellama
  ☆40Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆187Updated 9 months ago
• tensorpro / tpu_rwkv
  JAX implementations of RWKV
  ☆19Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆80Updated 3 months ago
• mrsteyk / RWKV-LM-deepspeed
  ☆42Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Narsil / bloomserver
  ☆37Updated 2 years ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆145Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• SmerkyG / RWKV_Explained
  RWKV, in easy to read code
  ☆69Updated 3 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆51Updated 11 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 4 months ago
• NolanoOrg / llama-int4-quant
  ☆26Updated 2 years ago
• SmerkyG / gptcore
  Fast modular code to create and train cutting edge LLMs
  ☆66Updated 9 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆44Updated 7 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 6 months ago
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 4 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year