Alternatives and similar repositories for nanoRWKV:

Users that are interested in nanoRWKV are comparing it to the libraries listed below

• yongchao98 / CodeSteer-v1.0
  Code and dataset of CodeSteer
  ☆55Updated last month
• RLHFlow / Minimal-RL
  ☆155Updated 3 weeks ago
• dvlab-research / MoTCoder
  This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…
  ☆80Updated last month
• RLHFlow / Online-RLHF
  A recipe for online RLHF and online iterative DPO.
  ☆508Updated 4 months ago
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆248Updated 8 months ago
• Ablustrund / MPLSandbox
  MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…
  ☆176Updated 3 weeks ago
• meta-math / MetaMath
  MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
  ☆433Updated last year
• RLHFlow / Self-rewarding-reasoning-LLM
  Recipes to train the self-rewarding reasoning LLMs.
  ☆216Updated 2 months ago
• Qcompiler / vllm-mixed-precision
  Support mixed-precsion inference with vllm
  ☆83Updated 3 months ago
• Ledzy / BAdam
  [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
  ☆257Updated last month
• CoIR-team / coir
  A Comprehensive Benchmark for Code Information Retrieval.
  ☆85Updated last month
• IAAR-Shanghai / ICSFSurvey
  Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…
  ☆167Updated 5 months ago
• zhuhanqing / APOLLO
  APOLLO: SGD-like Memory, AdamW-level Performance
  ☆212Updated 2 weeks ago
• MrYxJ / enhance_long
  This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …
  ☆45Updated last year
• longyuewangdcu / Document-MT-LLM
  ☆102Updated 2 years ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆189Updated 11 months ago
• IAAR-Shanghai / Grimoire
  Grimoire is All You Need for Enhancing Large Language Models
  ☆114Updated last year
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆126Updated 6 months ago
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆86Updated 2 weeks ago
• SmerkyG / RWKV_Explained
  RWKV, in easy to read code
  ☆72Updated last month
• wyu97 / GenRead
  Code and Checkpoints for "Generate rather than Retrieve: Large Language Models are Strong Context Generators" in ICLR 2023.
  ☆283Updated 2 years ago
• Mercury7353 / PyBench
  LLM Benchmark for Code
  ☆30Updated 9 months ago
• YangLinyi / GLUE-X
  We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …
  ☆93Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 11 months ago
• JacobPfau / fillerTokens
  ☆60Updated last year
• WeixiangYAN / CodeTransOcean
  [EMNLP 2023] CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation
  ☆52Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• sustcsonglin / mamba-triton
  ☆47Updated last year
• luo-junyu / RobustFT
  RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response
  ☆40Updated 4 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year