Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• teknium1 / ShareGPT-Builder
  ☆118Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆137Updated last year
• AK391 / dailypapersHN
  ☆86Updated last year
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆77Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• swyxio / openlangmem
  ☆47Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆77Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆104Updated 2 years ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• QuixiAI / generate
  ☆28Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• iulia-b10 / multilingual-embedding-models
  ☆20Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆77Updated 10 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• BBischof / yapping
  Verbosity control for AI agents
  ☆64Updated last year
• geronimi73 / qlora-minimal
  ☆88Updated 2 years ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• bipul1010 / agents_tutorial
  ☆19Updated last year
• NousResearch / finetuning-subnet
  ☆122Updated last year
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated last month
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆84Updated last year
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆211Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year