Alternatives and similar repositories for llama3-8x8b-MoE

Users that are interested in llama3-8x8b-MoE are comparing it to the libraries listed below

• FlagOpen / Infinity-Instruct
  ☆48Updated last year
• Zheng0428 / COIG-Kun
  ☆36Updated 9 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• swt-user / DMPO
  ☆42Updated 8 months ago
• TsinghuaC3I / Intuitive-Fine-Tuning
  [ACL 2025, Main Conference, Oral] Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  ☆28Updated 10 months ago
• InternLM / Condor
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆30Updated last month
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆57Updated last year
• Tomorrowdawn / top_nsigma
  The official code repo and data hub of top_nsigma sampling strategy for LLMs.
  ☆26Updated 4 months ago
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆34Updated 5 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆105Updated last month
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• fairyshine / Seal-Tools
  The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…
  ☆50Updated 7 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆159Updated 3 weeks ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆39Updated last month
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆160Updated this week
• seanzhang-zhichen / Qwen-WisdomVast
  Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …
  ☆18Updated last year
• multimodal-art-projection / COIG-P
  ☆38Updated 2 months ago
• RUC-GSAI / Llama-3-SynE
  Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …
  ☆33Updated 3 weeks ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 3 weeks ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆68Updated last month
• QwenLM / WorldPM
  ☆86Updated last month
• yyht / openrlhf_async_pipline
  ☆55Updated last week
• Alibaba-NLP / RankingGPT
  code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》
  ☆32Updated last year
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆113Updated 9 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• yegcjs / mixinglaws
  ☆101Updated 8 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 5 months ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year