Tiny-Megatron, a minimalistic re-implementation of the Megatron library
☆26Sep 1, 2025Updated 8 months ago
Alternatives and similar repositories for Tiny-Megatron
Users that are interested in Tiny-Megatron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆52Aug 20, 2025Updated 9 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆26Apr 8, 2026Updated last month
- ☆18Jan 4, 2024Updated 2 years ago
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆108Aug 20, 2025Updated 9 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- APEX+ is an LLM Serving Simulator☆46Jun 16, 2025Updated 11 months ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- Cut2Next: Generating Next Shot via In-Context Tuning☆33Aug 21, 2025Updated 9 months ago
- High performance inference engine for diffusion models☆108Sep 5, 2025Updated 8 months ago
- NexRL is an ultra-loosely-coupled LLM post-training framework.☆106May 13, 2026Updated 2 weeks ago
- Open-source toolkit for training, Priming, and serving next generation Hybrid architectures☆70May 9, 2026Updated 2 weeks ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆24May 20, 2026Updated last week
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Toolchain built around the Megatron-LM for Distributed Training☆95May 20, 2026Updated last week
- ☆13Nov 5, 2024Updated last year
- ☆38Jan 9, 2026Updated 4 months ago
- Learn CUDA with PyTorch☆303May 13, 2026Updated 2 weeks ago
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆14Oct 12, 2024Updated last year
- Official Implementation of MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models☆14Nov 1, 2025Updated 6 months ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated 2 years ago
- 🧠 Cognitive science-based Claude Skills for deep code understanding | 基于认知科学的源代码深度理解工具☆73Mar 26, 2026Updated 2 months ago
- A video question answering dataset that focuses on the dynamics properties of objects (velocity, acceleration) and their collisions withi…☆20Apr 23, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Nov 10, 2023Updated 2 years ago
- Official implementation of "Continual Learning by Modeling Intra-Class Variation" (MOCA). [TMLR 2023]☆16Mar 3, 2023Updated 3 years ago
- ☆24May 9, 2025Updated last year
- Generating Summaries with Controllable Readability Levels (EMNLP 2023)☆15Apr 8, 2026Updated last month
- Ongoing research training transformer models at scale☆18Updated this week
- ☆20Apr 24, 2026Updated last month
- ☆17Apr 10, 2025Updated last year
- [ACM MM 2023] The released code of paper "Deconfounded Visual Question Generation with Causal Inference"☆10Sep 3, 2024Updated last year
- [ICML 2025 Oral] This is the official repository of the paper "What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensi…☆22Jun 12, 2025Updated 11 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆104Aug 25, 2025Updated 9 months ago
- ☆32Jul 2, 2025Updated 10 months ago
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆40May 7, 2026Updated 3 weeks ago
- [CVPR 2025] VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning☆13Jun 7, 2025Updated 11 months ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 9 months ago
- MutiModel paper reading (Visual, Audio)☆22Nov 24, 2025Updated 6 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated last month