Alternatives and similar repositories for FastLLM

Users that are interested in FastLLM are comparing it to the libraries listed below

• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆33Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆137Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 11 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated 2 years ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆126Updated 11 months ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆60Updated last year
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• Bui1dMySea / MemLong
  ☆95Updated last year
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆113Updated last year
• Zheng0428 / COIG-Kun
  ☆36Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 4 months ago
• Alibaba-NLP / RankingGPT
  code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》
  ☆34Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated last year
• QwenLM / WorldPM
  ☆93Updated 7 months ago
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆43Updated last year
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆80Updated last year
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆43Updated 9 months ago
• THUDM / LongReward
  ☆61Updated last year
• yongchao98 / PROMST
  Automatic prompt optimization framework for multi-step agent tasks.
  ☆36Updated last year
• HITsz-TMG / KaLM-Embedding
  Code for KaLM-Embedding models
  ☆104Updated 5 months ago
• multimodal-art-projection / Megatron-LM-NEO
  ☆40Updated last year
• liuqi6777 / pe_rank
  Leveraging passage embeddings for efficient listwise reranking with large language models.
  ☆49Updated last year
• THUDM / ChatGLM-Math
  ☆83Updated last year
• ByteDance-Seed / WideSearch
  WideSearch: Benchmarking Agentic Broad Info-Seeking
  ☆106Updated 2 months ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆59Updated last year
• open-compass / CompassVerifier
  [EMNLP 2025] CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
  ☆59Updated 4 months ago
• GeneZC / MiniMA
  Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"
  ☆102Updated last year
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆76Updated 10 months ago