lukasVierling / FaceRWKV
Course Project for COMP4471 on RWKV
☆17Updated last year
Alternatives and similar repositories for FaceRWKV:
Users that are interested in FaceRWKV are comparing it to the libraries listed below
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆28Updated last week
- RWKV, in easy to read code☆67Updated 2 months ago
- RWKV-7: Surpassing GPT☆79Updated 3 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆39Updated 8 months ago
- A converter and basic tester for rwkv onnx☆42Updated last year
- Experiments with BitNet inference on CPU☆53Updated 10 months ago
- tinygrad port of the RWKV large language model.☆44Updated 8 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 9 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆17Updated 4 months ago
- ☆44Updated 7 months ago
- RWKV in nanoGPT style☆187Updated 8 months ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆20Updated last year
- ☆34Updated 7 months ago
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆31Updated this week
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆31Updated 6 months ago
- Training a reward model for RLHF using RWKV.☆14Updated last year
- GoldFinch and other hybrid transformer components☆43Updated 7 months ago
- Trying to deconstruct RWKV in understandable terms☆14Updated last year
- entropix style sampling + GUI☆25Updated 3 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆51Updated 10 months ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆20Updated this week
- A fast RWKV Tokenizer written in Rust☆42Updated 5 months ago
- Testing LLM reasoning abilities with family relationship quizzes.☆57Updated 3 weeks ago
- Inference of Mamba models in pure C☆183Updated 11 months ago
- RWKV centralised docs for the community☆20Updated last month
- QuIP quantization☆50Updated 11 months ago
- Video+code lecture on building nanoGPT from scratch☆65Updated 8 months ago