Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
☆330Updated this week
Alternatives and similar repositories for Automodel
Users that are interested in Automodel are comparing it to the libraries listed below
Sorting:
- Training library for Megatron-based models with bidirectional Hugging Face conversion capability☆459Updated this week
- Scalable toolkit for efficient model reinforcement☆1,353Updated this week
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Tools and Scripts for running Isaac Sim workloads on Omniverse Farm☆11Jun 15, 2025Updated 8 months ago
- ☆46May 20, 2025Updated 9 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆91Updated this week
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- Minimalistic large language model 3D-parallelism training☆2,569Feb 19, 2026Updated last week
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆99Aug 20, 2025Updated 6 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆88Sep 11, 2025Updated 5 months ago
- ☆31Apr 19, 2025Updated 10 months ago
- ☆27Oct 15, 2025Updated 4 months ago
- [RA-L] SHeRLoc: Synchronized Heterogeneous Radar Place Recognition for Cross-Modal Localization☆28Nov 24, 2025Updated 3 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆50Aug 20, 2025Updated 6 months ago
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆23Sep 23, 2025Updated 5 months ago
- An in-memory Vector Database & AI Gateway written in Go. Supports HNSW, Hybrid Search (BM25), GraphRAG context, a built-in RAG Pipeline, …☆56Feb 21, 2026Updated last week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆92Jan 26, 2026Updated last month
- GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…☆324Nov 11, 2025Updated 3 months ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆938Nov 27, 2025Updated 3 months ago
- Scalable data pre processing and curation toolkit for LLMs☆1,424Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,170Feb 21, 2026Updated last week
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆13Jan 16, 2026Updated last month
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…☆58Oct 27, 2025Updated 4 months ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- Accelerating MoE with IO and Tile-aware Optimizations☆591Updated this week
- Large Context Attention☆769Oct 13, 2025Updated 4 months ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆19Dec 8, 2023Updated 2 years ago
- ☆23Oct 30, 2025Updated 4 months ago
- The core repository for Katanemo's advanced function calling models with top-tier performance. Features three collections: Arch-Function …☆20Jun 23, 2025Updated 8 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Mar 21, 2022Updated 3 years ago
- ☆18Jun 3, 2024Updated last year
- Socratic-Zero is a fully autonomous framework that generates high-quality training data for mathematical reasoning☆35Oct 26, 2025Updated 4 months ago
- Apache arrow examples in golang☆16Apr 27, 2021Updated 4 years ago
- A PyTorch native platform for training generative AI models☆5,098Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆469Updated this week
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆166Jan 22, 2026Updated last month
- ☆36Jan 25, 2026Updated last month
- ☆26Oct 9, 2024Updated last year
- Tiny-Megatron, a minimalistic re-implementation of the Megatron library☆23Sep 1, 2025Updated 5 months ago