Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA
☆31Nov 27, 2025Updated 3 months ago
Alternatives and similar repositories for FSDP-Training
Users that are interested in FSDP-Training are comparing it to the libraries listed below
Sorting:
- Offical implementation of "Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation" (AAAI2025 Oral)☆37Jan 14, 2026Updated last month
- [ICLR 2024] Official implementation of Spiking Graph Contrastive Learning (0️⃣1️⃣ SpikeGCL)☆30May 8, 2024Updated last year
- Official PyTorch implementation of "GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance" (ICML 2025)☆50Jul 6, 2025Updated 7 months ago
- ACL 2023☆39Jun 6, 2023Updated 2 years ago
- This is the implentation of our paper "SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms" in ICML…☆41Jul 9, 2024Updated last year
- Enhancing Domain Adaptation through Prompt Gradient Alignment (NeurIPS 2024)☆14Jun 16, 2024Updated last year
- Code accompanying the NeurIPS 2019 paper AutoAssist: A Framework to Accelerate Training of Deep Neural Networks.☆14Oct 3, 2022Updated 3 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- Cheatsheet for slurm command lines☆10Apr 9, 2023Updated 2 years ago
- netbeacon - monitoring your network capture, NIDS or network analysis process☆19Oct 26, 2013Updated 12 years ago
- Official repo for paper "HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies"☆23Dec 12, 2025Updated 2 months ago
- Peking University Convex Optimization Course given by Professor Wen Zaiwen☆11Jan 11, 2018Updated 8 years ago
- ☆11Apr 3, 2023Updated 2 years ago
- For our ISSTA'23 paper ACETest: Automated Constraint Extraction for Testing Deep Learning Operators☆13Mar 30, 2024Updated last year
- ☆15Jul 18, 2023Updated 2 years ago
- [CVPR 2022] AlignQ: Alignment Quantization with ADMM-based Correlation Preservation☆11Jan 6, 2023Updated 3 years ago
- 🕹 Implementation for the lesson Compiling Engineering(2020 Spring) in Peking University, adjusted from UCLA CS 132 Project.☆10Jun 21, 2020Updated 5 years ago
- A tool for cross-checking Verilog compilers☆14Apr 16, 2025Updated 10 months ago
- ☆12Jul 6, 2023Updated 2 years ago
- ☆13Jan 21, 2022Updated 4 years ago
- Visual Question Answering System☆11Nov 13, 2019Updated 6 years ago
- 🛠Robust SSH: auto-reconnect SSH session that preserves your running shell and command. Intuitive, no server-side setup, aimed at simplic…☆13Nov 14, 2025Updated 3 months ago
- ☆11Mar 13, 2023Updated 2 years ago
- Minimal Transformer base in JAX. A single backbone for language modelling, diffusion, classification, etc...☆13May 28, 2025Updated 9 months ago
- ☆12Aug 26, 2022Updated 3 years ago
- A Coq framework to support structural design and proof of hardware cache-coherence protocols☆14May 7, 2022Updated 3 years ago
- ☆10Jun 4, 2021Updated 4 years ago
- ☆10May 16, 2021Updated 4 years ago
- ☆20Jul 29, 2024Updated last year
- Jieba 0.39 的 Java 复刻版，支持原版 Jieba 的所有核心功能☆12Feb 14, 2019Updated 7 years ago
- FPGA-based HyperLogLog Accelerator☆12Jul 13, 2020Updated 5 years ago
- Kernel Module that implements Paxos protocol☆12Oct 23, 2020Updated 5 years ago
- ☆10Jun 27, 2024Updated last year
- ☆11Oct 21, 2023Updated 2 years ago
- POPGym Library in JAX☆12Apr 15, 2024Updated last year
- Chaitin-Briggs register-allocation algorithm (LLVM back-end)☆12Jan 6, 2016Updated 10 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆14Apr 30, 2025Updated 10 months ago
- PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.☆10Feb 10, 2022Updated 4 years ago
- How to plot for papers, slides, demos, etc.☆10Apr 7, 2022Updated 3 years ago