Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• arcee-ai / DAM
  ☆55Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆69Updated 2 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• choosewhatulike / case2code
  ☆17Updated 9 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆67Updated 8 months ago
• mungg / FABLES
  ☆59Updated last year
• miralab-ai / autoreason
  ☆39Updated last year
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆107Updated last year
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆110Updated last week
• reka-ai / rekaquant
  ☆62Updated 6 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆61Updated 6 months ago
• foundation-model-stack / fms-model-optimizer
  FMS Model Optimizer is a framework for developing reduced precision neural network models.
  ☆20Updated 2 weeks ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆106Updated 8 months ago
• liujch1998 / infini-gram
  ☆90Updated last month
• ibm-granite / granite-embedding-models
  ☆51Updated 3 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆32Updated last year
• QuixiAI / SystemChat
  ☆32Updated last year
• huggingface / trl-jobs
  Train LLM on Hugging Face infra
  ☆67Updated 2 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆81Updated last year
• QuixiAI / spectrum
  ☆138Updated 4 months ago
• camel-ai / seta-env
  💻 SETA: Scaling Environments for Terminal Agents - Environments
  ☆38Updated last week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆114Updated 8 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year