Alternatives and similar repositories for simple-lora-plus

Users that are interested in simple-lora-plus are comparing it to the libraries listed below

• WALLE-AI / uReasoningLLMs
  Deepseek-r1复现科普与资源汇总
  ☆21Updated 3 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆36Updated last year
• TUDB-Labs / Awesome-LLM-LoRA
  ☆15Updated last year
• cheerss / SciPIP
  The official repository for the Scientific Paper Idea Proposer (SciPIP)
  ☆62Updated 4 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆84Updated 3 months ago
• OpenBMB / R1-Router
  This is the code repo for the paper "Learning to Route Queries Across Knowledge Bases for Step-wise Retrieval-Augmented Reasoning".
  ☆16Updated last month
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• maidacundo / MoE-LoRA
  Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
  ☆42Updated 8 months ago
• KaihuaTang / LLM-TP-Inference-on-910B
  本项目提供了基于910B的huggingface LLM模型的Tensor Parallel(TP)部署教程，同时也可以作为一份极简的TP学习代码。
  ☆25Updated 9 months ago
• chunhuizhang / llm_rl
  llm & rl
  ☆151Updated this week
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆128Updated last week
• THU-KEG / AdaptThink
  ☆116Updated last month
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆122Updated 7 months ago
• MIRALab-USTC / LLM-AttentionPredictor
  The code for "AttentionPredictor: Temporal Pattern Matters for Efficient LLM Inference", Qingyue Yang, Jie Wang, Xing Li, Zhihai Wang, Ch…
  ☆18Updated last month
• KaihuaTang / Qwen-Tokenizer-Pruner
  Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…
  ☆22Updated 10 months ago
• THUDM / Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models
  Parameter-Efficient Fine-Tuning for Foundation Models
  ☆69Updated 2 months ago
• Outsider565 / LoRA-GA
  ☆201Updated 8 months ago
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆168Updated 11 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆53Updated 10 months ago
• xyjigsaw / LLM-Pretrain-SFT
  Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)
  ☆80Updated last year
• Marstaos / MetaSearch
  MetaSearch：llm深度研究（deepsearch）功能方案实现
  ☆30Updated 2 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆64Updated 4 months ago
• XU-YIJIE / grpo-flat
  Train your grpo with zero dataset and low resources, 8bit/4bit/lora/qlora supported, multi-gpu supported ...
  ☆73Updated last month
• thinkwee / AgentsMeetRL
  An Awesome List of Reinforcement Learning-based Large Language Agent Works. Collect directly from official code base.
  ☆154Updated this week
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆46Updated last month
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆73Updated 4 months ago
• abdelfattah-lab / SplitReason
  ☆16Updated this week
• wutaiqiang / LLM_KD_AKL
  ☆15Updated 8 months ago
• dongguanting / DPA-RAG
  The code and data of DPA-RAG, accepted by WWW 2025 main conference.
  ☆61Updated 5 months ago
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆75Updated 3 weeks ago