Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 2 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below
Sorting:
- ☆32Feb 4, 2026Updated last month
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 9 months ago
- ☆63Mar 4, 2022Updated 4 years ago
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 3 months ago
- A neural network layer API and library for sequence modeling, designed for easy creation of sequence models that can be executed layerwis…☆56Feb 20, 2026Updated last week
- Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesia☆10Nov 18, 2023Updated 2 years ago
- ☆10Oct 9, 2025Updated 4 months ago
- One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework☆21Oct 25, 2023Updated 2 years ago
- Sudoku solver in Golang☆10Sep 6, 2020Updated 5 years ago
- Imports OpenStreetMap data into a Neo4j graph database. Produces a simple schema that includes nodes, ways, and all properties/tags conta…☆11Apr 14, 2023Updated 2 years ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Jan 30, 2026Updated last month
- Wenet speech to text for react native☆10Nov 1, 2022Updated 3 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- MIPS I simulator☆20Dec 28, 2018Updated 7 years ago
- Weekly data science workshops for SIG AIDA at UIUC.☆12Jun 22, 2022Updated 3 years ago
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆12Dec 3, 2023Updated 2 years ago
- Gym implementation of connector to Deepmind lab☆12Mar 26, 2019Updated 6 years ago
- [ICLR 2022] Boosting Randomized Smoothing with Variance Reduced Classifiers☆12Mar 29, 2022Updated 3 years ago
- Emacs 中看 B 站☆11Jul 27, 2025Updated 7 months ago
- Repo for the paper "Bounding Training Data Reconstruction in Private (Deep) Learning".☆11Jun 16, 2023Updated 2 years ago
- Teaching a Convolutional Neural Network to recognize painting genre. Handcrafted dataset. Cool visualizations.☆10Dec 19, 2018Updated 7 years ago
- ☆10Jun 1, 2022Updated 3 years ago
- ☆15May 11, 2025Updated 9 months ago
- a minimalistic todo app☆10May 10, 2023Updated 2 years ago
- Linking field-based and airborne data☆11Apr 5, 2020Updated 5 years ago
- Jax implementation of a flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm☆12Jan 29, 2025Updated last year
- ☆11May 12, 2023Updated 2 years ago
- BFloat16 Fused Adam Operator for PyTorch☆16Nov 16, 2024Updated last year
- tmux cheatsheet in terminal friendly text format.☆10Jan 7, 2022Updated 4 years ago
- An unnecessarily tiny and minimal implementation of GPT-2 in NumPy.☆11Feb 12, 2023Updated 3 years ago
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- A list of advice on doing research that is useful for me :)☆13Aug 17, 2019Updated 6 years ago
- Author's PyTorch implementation of paper "Provably Good Batch Reinforcement Learning Without Great Exploration"☆12Oct 22, 2020Updated 5 years ago
- Tensor Parallelism with JAX + Shard Map☆11Sep 29, 2023Updated 2 years ago
- KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generation☆36Feb 6, 2026Updated 3 weeks ago
- Basic C++ Hidden Markov Model functionality implementation with state prediction estimation☆15Apr 29, 2013Updated 12 years ago
- [ICML 2022] Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum☆11Jul 15, 2022Updated 3 years ago
- an openai chatbot that lets you talk to a git repository☆10Jul 27, 2024Updated last year
- Notebooks for managing NeurIPS 2014 and analysing the NeurIPS experiment.☆13May 22, 2024Updated last year