Alternatives and similar repositories for rwkv-cpp-accelerated

Users that are interested in rwkv-cpp-accelerated are comparing it to the libraries listed below

• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆146Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆413Updated 2 years ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆413Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆315Updated 3 weeks ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆493Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆193Updated last year
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,544Updated 5 months ago
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• Abel2076 / json2binidx_tool
  ☆81Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆199Updated 2 years ago
• ggml-org / p1
  LLM-based code completion engine
  ☆193Updated 7 months ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 6 months ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆29Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆191Updated last year
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆52Updated 2 years ago
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆43Updated last year
• jiamingkong / RWKV_chains
  Enhancing LangChain prompts to work better with RWKV models
  ☆34Updated 2 years ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆277Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆519Updated 2 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆456Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆107Updated last year
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• lachlansneff / sparsellama
  ☆40Updated 2 years ago