Ongoing research training transformer models at scale
☆13Nov 5, 2026Updated last week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 4 months ago
- A list of papers for Graph Retrieval-Augmented Generation (GraphRAG).☆10Mar 13, 2025Updated last year
- ☆11Jan 9, 2019Updated 7 years ago
- verl Zero-Mismatch Dense/MoE HuggingFace Rollout☆77Updated this week
- ☆32Jul 2, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Agent-friendly GPU profile-query CLI☆131Oct 4, 2026Updated last month
- A data processing framework☆11Jul 19, 2017Updated 9 years ago
- (best/better) practices of megatron on veRL and tuning guide☆141May 12, 2026Updated 6 months ago
- Fast and memory-efficient exact attention☆23Updated this week
- Bridging python and matlab version OTB☆11Jan 12, 2018Updated 8 years ago
- A PyTorch implementation of the ACM SIGKDD 2021 paper titled "PETGEN: Personalized Text Generation Attack on Deep Sequence Embedding-base…☆17Dec 19, 2023Updated 2 years ago
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 3 years ago
- Sources to www.mlpack.org.☆13Jun 19, 2026Updated 4 months ago
- Train computer-use agents end-to-end on real desktops, at scale: a high-performance runtime where 8K+ live environments on one laptop thr…☆20Sep 4, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLMGeo: Benchmarking Large Language Models on Image Geolocation In-the-wild☆16Oct 31, 2024Updated 2 years ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- Rust implementation of RaBitQ + IVF and MSTG (multi-scale tree graph)☆19Feb 26, 2026Updated 8 months ago
- ONNX Python Examples☆16Sep 13, 2022Updated 4 years ago
- valve source engine hooking on OS X using libembryo, no sdk required☆10Sep 21, 2016Updated 10 years ago
- Understanding attention for text classification☆16Nov 27, 2020Updated 5 years ago
- A code repository accompanying the paper "Transformers, parallel computation, and logarithmic depth" by Clayton Sanford, Daniel Hsu, and …☆12Feb 15, 2024Updated 2 years ago
- Translation Mod for Dwarf Fortress☆14Aug 12, 2026Updated 3 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆11Jul 21, 2024Updated 2 years ago
- A parameter server implement with MPI.☆11Nov 15, 2017Updated 8 years ago
- NCCL tutorial at PyTorch Conference China 2026☆27Sep 8, 2026Updated 2 months ago
- ☆10Sep 19, 2026Updated last month
- ESPN: Embedding from Storage Pipelined Network. GDS implementation for multi-vector embedding retrieval and bindings.☆12May 18, 2024Updated 2 years ago
- Understand your LLM before deploy☆78Updated this week
- This is the repo for our work “Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation” (EMNLP 2023)…☆11Oct 25, 2023Updated 3 years ago
- A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Gemini CLI & Hermes Agent. Only official websit…☆14Aug 30, 2026Updated 2 months ago
- ☆16Jul 12, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆12Jul 13, 2026Updated 3 months ago
- An asynchronous streaming data management module for efficient post-training.☆175Updated this week
- ☆11Oct 17, 2024Updated 2 years ago
- ☆12Nov 21, 2025Updated 11 months ago
- ☆11May 21, 2026Updated 5 months ago
- cuda best practice & notes☆10Oct 24, 2025Updated last year
- ☆10Jan 15, 2018Updated 8 years ago
Are these results useful?