Alternatives and similar repositories for Megatron-LM:

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• xjdr-alt / muzero_sketch
  ☆38Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 9 months ago
• teknium1 / ShareGPT-Builder
  ☆112Updated 3 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆95Updated last month
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆61Updated 10 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 7 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆31Updated last month
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆60Updated last month
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆34Updated last month
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆63Updated 5 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆38Updated last month
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• swyxio / openlangmem
  ☆47Updated last year
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year