Tiny-Megatron, a minimalistic re-implementation of the Megatron library
☆27Sep 1, 2025Updated 9 months ago
Alternatives and similar repositories for Tiny-Megatron
Users that are interested in Tiny-Megatron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated 10 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆28Apr 8, 2026Updated 2 months ago
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆110Aug 20, 2025Updated 9 months ago
- APEX+ is an LLM Serving Simulator☆48Jun 16, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- ☆51Jul 30, 2025Updated 10 months ago
- High performance inference engine for diffusion models☆108Sep 5, 2025Updated 9 months ago
- NexRL is an ultra-loosely-coupled LLM post-training framework.☆114May 13, 2026Updated last month
- Open-source toolkit for training, Priming, and serving next generation Hybrid architectures☆72Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆27Updated this week
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated 2 years ago
- Toolchain built around the Megatron-LM for Distributed Training☆95May 20, 2026Updated 3 weeks ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆92Feb 14, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Jan 7, 2023Updated 3 years ago
- ☆39Jan 9, 2026Updated 5 months ago
- Learn CUDA with PyTorch☆330Jun 1, 2026Updated 2 weeks ago
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆45May 13, 2025Updated last year
- ☆15Feb 11, 2025Updated last year
- A video question answering dataset that focuses on the dynamics properties of objects (velocity, acceleration) and their collisions withi…☆20Apr 23, 2025Updated last year
- Official implementation of "Continual Learning by Modeling Intra-Class Variation" (MOCA). [TMLR 2023]☆16Mar 3, 2023Updated 3 years ago
- an implementation of parallel skills like amp, ddp, pp, tp for learning purposes☆14Nov 18, 2023Updated 2 years ago
- ☆24May 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Generating Summaries with Controllable Readability Levels (EMNLP 2023)☆15Apr 8, 2026Updated 2 months ago
- Ongoing research training transformer models at scale☆18Updated this week
- [ACL 2026 🔥] CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark☆34Apr 20, 2026Updated last month
- ☆20May 30, 2026Updated 2 weeks ago
- ☆17Apr 10, 2025Updated last year
- [ACM MM 2023] The released code of paper "Deconfounded Visual Question Generation with Causal Inference"☆10Sep 3, 2024Updated last year
- 🧠 Cognitive science-based Claude Skills for deep code understanding | 基于认知科学的源代码深度理解工具☆90Mar 26, 2026Updated 2 months ago
- [ICML 2025 Oral] This is the official repository of the paper "What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensi…☆22Jun 12, 2025Updated last year
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆105Aug 25, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆32Jul 2, 2025Updated 11 months ago
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆46Jun 2, 2026Updated 2 weeks ago
- [CVPR 2025] VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning☆13Jun 7, 2025Updated last year
- Apple's Cut Cross Entropy☆30Jan 19, 2025Updated last year
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated 2 months ago
- PyTorch distributed training from scratch (for educational purposes only)☆22Apr 12, 2025Updated last year
- The PyTorch implementation of DSM (EMNLP 2022).☆10Mar 26, 2024Updated 2 years ago