Alternatives and similar repositories for rwkv-cpp-accelerated

Users that are interested in rwkv-cpp-accelerated are comparing it to the libraries listed below

• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated last year
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆413Updated last year
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,529Updated 3 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆310Updated this week
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆191Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆82Updated last year
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆493Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆194Updated 5 months ago
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆197Updated 2 years ago
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆409Updated 2 years ago
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated 10 months ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆277Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆46Updated 3 months ago
• Vahe1994 / SpQR
  ☆543Updated 6 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆302Updated 2 years ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• BlinkDL / RWKV-CUDA
  The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
  ☆222Updated 6 months ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• resloved / RWKV-notebooks
  📖 — Notebooks related to RWKV
  ☆59Updated 2 years ago
• zphang / minimal-llama
  ☆458Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆51Updated 2 years ago
• AlpinDale / RPTQ-for-LLaMA
  Efficient 3bit/4bit quantization of LLaMA models
  ☆19Updated 2 years ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆502Updated last week