Alternatives and similar repositories for nanoRWKV

Users that are interested in nanoRWKV are comparing it to the libraries listed below

• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆124Updated this week
• RLHFlow / Minimal-RL
  ☆196Updated 3 weeks ago
• yongchao98 / CodeSteer-v1.0
  Code and dataset of CodeSteer
  ☆56Updated 2 months ago
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆253Updated 9 months ago
• dvlab-research / MoTCoder
  This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…
  ☆82Updated 2 months ago
• Ledzy / BAdam
  [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
  ☆258Updated 2 months ago
• RLHFlow / Online-RLHF
  A recipe for online RLHF and online iterative DPO.
  ☆514Updated 5 months ago
• CoIR-team / coir
  (ACL 2025 Main) A Comprehensive Benchmark for Code Information Retrieval.
  ☆94Updated last week
• IAAR-Shanghai / Grimoire
  Grimoire is All You Need for Enhancing Large Language Models
  ☆115Updated last year
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆92Updated 2 weeks ago
• Qcompiler / vllm-mixed-precision
  Support mixed-precsion inference with vllm
  ☆83Updated 4 months ago
• Ablustrund / MPLSandbox
  MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…
  ☆176Updated last month
• MrYxJ / enhance_long
  This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …
  ☆45Updated last year
• RLHFlow / Self-rewarding-reasoning-LLM
  Recipes to train the self-rewarding reasoning LLMs.
  ☆219Updated 3 months ago
• meta-math / MetaMath
  MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
  ☆434Updated last year
• zhuhanqing / APOLLO
  APOLLO: SGD-like Memory, AdamW-level Performance
  ☆234Updated last month
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆88Updated 6 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆58Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆189Updated 11 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 10 months ago
• luo-junyu / RobustFT
  RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response
  ☆41Updated 5 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆202Updated last year
• longyuewangdcu / Document-MT-LLM
  ☆102Updated 2 years ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 9 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• HazyResearch / based
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆234Updated 3 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 9 months ago
• IAAR-Shanghai / ICSFSurvey
  Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…
  ☆168Updated 5 months ago