Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• arcee-ai / DAM
  ☆54Updated 10 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 10 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 9 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• miralab-ai / autoreason
  ☆40Updated 9 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆62Updated 4 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆106Updated 11 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last month
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆64Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆72Updated 5 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated 7 months ago
• QuixiAI / kraken
  ☆67Updated last year
• mungg / FABLES
  ☆57Updated 11 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• nyunAI / PruneGPT
  ☆51Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated 10 months ago
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆27Updated 9 months ago
• JHU-CLSP / mmBERT
  A massively multilingual modern encoder language model
  ☆80Updated last week
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆38Updated 5 months ago
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆54Updated 2 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆87Updated 2 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆92Updated 4 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• lightblue-tech / lb-reranker
  ☆23Updated 7 months ago
• QuixiAI / spectrum
  ☆135Updated 3 weeks ago