Alternatives and similar repositories for Megatron-LM:

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• lordspline / DevOn
  ☆41Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• teknium1 / ShareGPT-Builder
  ☆113Updated 4 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 9 months ago
• swyxio / openlangmem
  ☆47Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆27Updated last month
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 5 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• cognitivecomputations / generate
  ☆28Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 3 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 9 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• foobarbaz-inc / conversation-memory-streamlit
  Demo of ConversationEntityMemory in Streamlit.
  ☆52Updated 2 years ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• CERC-AAI / Robin
  ☆63Updated 7 months ago
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆73Updated last week
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year