Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 9 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆64Updated 11 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆139Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆76Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆65Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated last year
• AK391 / dailypapersHN
  ☆86Updated 11 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆105Updated 6 months ago
• BerriAI / instructprompt
  ☆107Updated 2 years ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated 10 months ago
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆77Updated last year
• Nearcyan / papers.day
  papers.day
  ☆91Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆39Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated 7 months ago
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated last year
• abacaj / openhermes-function-calling
  ☆135Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 6 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆31Updated 11 months ago
• NousResearch / StripedHyenaTrainer
  ☆62Updated last year
• xjdr-alt / muzero_sketch
  ☆39Updated last year
• kookaburracodes / investor-education-chatchain
  Not financial advice.
  ☆28Updated 2 years ago
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆32Updated last year