Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 3 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 7 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• SohamGovande / podplex
  🦾💻🌐 distributed training & serverless inference at scale on RunPod
  ☆17Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 2 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆86Updated 2 weeks ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated 8 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆36Updated last year
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• brendanhogan / picoDeepResearch
  ☆57Updated last week
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆66Updated 8 months ago
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆75Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆19Updated last year
• mshumer / portal
  ☆28Updated 6 months ago
• kookaburracodes / investor-education-chatchain
  Not financial advice.
  ☆27Updated 2 years ago
• foobarbaz-inc / conversation-memory-streamlit
  Demo of ConversationEntityMemory in Streamlit.
  ☆51Updated 2 years ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆63Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆62Updated this week
• omegalabsinc / omegalabs-anytoany-bittensor
  Making the world's first and smartest opensource any-to-any AGI system
  ☆40Updated this week
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆64Updated 6 months ago
• diicellman / dynamite-dogs
  BH hackathon
  ☆13Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year