Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
☆408Apr 5, 2026Updated this week
Alternatives and similar repositories for Automodel
Users that are interested in Automodel are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Training library for Megatron-based models with bidirectional Hugging Face conversion capability☆553Updated this week
- Scalable toolkit for efficient model reinforcement☆1,500Updated this week
- State-of-the-art framework for fast, large-scale training and inference of diffusion models☆47Apr 2, 2026Updated last week
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆51Aug 20, 2025Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Minimalistic large language model 3D-parallelism training☆2,632Apr 2, 2026Updated last week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆97Updated this week
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆19Sep 17, 2025Updated 6 months ago
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆13Jan 16, 2026Updated 2 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆205Apr 2, 2026Updated last week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,256Updated this week
- Ongoing research training transformer models at scale☆18Apr 3, 2026Updated last week
- Scalable data pre processing and curation toolkit for LLMs☆1,520Updated this week
- Accelerating MoE with IO and Tile-aware Optimizations☆621Apr 1, 2026Updated last week
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆331Nov 11, 2025Updated 4 months ago
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆101Aug 20, 2025Updated 7 months ago
- ☆49May 20, 2025Updated 10 months ago
- ☆32Apr 19, 2025Updated 11 months ago
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆1,046Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆497Mar 24, 2026Updated 2 weeks ago
- A PyTorch native platform for training generative AI models☆5,205Apr 3, 2026Updated last week
- [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…☆16Feb 4, 2025Updated last year
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…☆60Oct 27, 2025Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- a simple API to use CUPTI☆10Aug 19, 2025Updated 7 months ago
- ☆31Dec 31, 2025Updated 3 months ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆1,004Mar 3, 2026Updated last month
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆99Sep 11, 2025Updated 6 months ago
- ☆12Feb 9, 2026Updated 2 months ago
- A tool to configure, launch and manage your machine learning experiments.☆233Updated this week
- A lightweight, AI-native training framework for large language models. Designed for fast iteration, reproducible experiments, and modular…☆535Updated this week
- Ongoing research training transformer models at scale☆15,900Apr 3, 2026Updated last week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆95Mar 31, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆171Updated this week
- A lightweight, user-friendly data-plane for LLM training.☆38Sep 10, 2025Updated 7 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆22Mar 25, 2026Updated 2 weeks ago
- Ship correct and fast LLM kernels to PyTorch☆147Jan 14, 2026Updated 2 months ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆182Mar 17, 2026Updated 3 weeks ago
- InternDataEngine: Pioneering High-Fidelity Synthetic Data Generator for Robotic Manipulation☆91Mar 20, 2026Updated 3 weeks ago
- Large Context Attention☆770Oct 13, 2025Updated 5 months ago