Alternatives and similar repositories for LLM-Training

Users that are interested in LLM-Training are comparing it to the libraries listed below

• zake7749 / Kyara
  [Kaggle-2nd] Lightweight yet Effective Chinese LLM.
  ☆52Updated 4 months ago
• aqweteddy / ChatVector
  Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …
  ☆55Updated last year
• mtkresearch / generative-fusion-decoding
  Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…
  ☆85Updated 3 months ago
• DAMO-NLP-SG / DAMO-SeaLLMs
  [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
  ☆173Updated last year
• MIBlue119 / awesome-llama-resources
  just collections about Llama2
  ☆44Updated last year
• TMMMU-Benchmark / evaluation
  Evaluation code for benchmarking VLMs in traditional chinese understanding
  ☆13Updated 6 months ago
• DAMO-NLP-SG / SeaLLMs-Audio
  ☆49Updated 2 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆89Updated 11 months ago
• MathGenie / MathGenie
  ☆13Updated last year
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆24Updated 2 weeks ago
• hamishivi / tess-2
  Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"
  ☆51Updated 8 months ago
• fkodom / grouped-query-attention-pytorch
  (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …
  ☆181Updated last year
• danny911kr / REALTALK
  Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.
  ☆31Updated 3 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆124Updated last year
• Mr-Tieguigui / LLM-Post-Training
  ☆68Updated 5 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆125Updated 7 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆179Updated 7 months ago
• mtkresearch / TASTE-SpokenLM
  A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…
  ☆96Updated last month
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆268Updated 9 months ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆126Updated last year
• fzp0424 / MT-R1-Zero
  [EMNLP'25] Code for paper "MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning"
  ☆60Updated 6 months ago
• TsinghuaC3I / Fourier-Position-Embedding
  [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆100Updated 5 months ago
• ntunlplab / traditional-chinese-alpaca
  A Traditional-Chinese instruction-following model with datasets based on Alpaca.
  ☆137Updated 2 years ago
• NJUNLP / MoE-LPR
  ☆18Updated 10 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 6 months ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆48Updated 7 months ago
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆104Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆152Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆180Updated 4 months ago
• JieShibo / MoLE
  [ICML 2025 Oral] Mixture of Lookup Experts
  ☆53Updated 5 months ago