Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 3 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pruning is all you need (hopefully)☆12Sep 7, 2022Updated 3 years ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 8 months ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆31Jun 5, 2025Updated last year
- One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework☆21Oct 25, 2023Updated 2 years ago
- ☆62Mar 4, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆13Dec 3, 2023Updated 2 years ago
- Go check that checks that Go source and tests compiles☆17Updated this week
- ☆14Oct 22, 2016Updated 9 years ago
- Jax implementation of a flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm☆13Jan 29, 2025Updated last year
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Range-based algorithms in Go☆14Sep 10, 2023Updated 2 years ago
- Wenet speech to text for react native☆10Nov 1, 2022Updated 3 years ago
- Cycling, Incremental, Compressed, Encrypted Backups to Amazon S3.☆15Jun 7, 2021Updated 5 years ago
- Video face recognition and content creator collaboration detection framework.☆15Mar 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Sep 20, 2024Updated last year
- Visual Studio Code extension for KiteConnect API☆14Jan 13, 2018Updated 8 years ago
- NanoGPT (124M) in 5 minutes☆16Feb 14, 2025Updated last year
- A worker pool library for Rust☆13Jul 27, 2026Updated 2 weeks ago
- A python implementation of the nobel prize winning matching algorithm.☆11Nov 22, 2023Updated 2 years ago
- ☆12Oct 9, 2025Updated 10 months ago
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…☆17Nov 11, 2024Updated last year
- Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge☆10Aug 8, 2023Updated 3 years ago
- Parallel Computing starter project to build GPU & CPU kernels in CUDA & C++ and call them from Python without a single line of CMake usin…☆31Oct 14, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14May 26, 2020Updated 6 years ago
- a minimalistic todo app☆10May 10, 2023Updated 3 years ago
- Bookmark directories for easy directory-hopping in the terminal☆14Sep 10, 2025Updated 11 months ago
- ☆15May 11, 2025Updated last year
- Forced alignment decoder for Whisper.☆16Mar 13, 2024Updated 2 years ago
- Sudoku solver in Golang☆10Sep 6, 2020Updated 5 years ago
- KiCAD parser written in python☆18Nov 19, 2024Updated last year
- Solve the Humans Not Invited problem☆15Jul 20, 2023Updated 3 years ago
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Rust powered background process CLI task manager☆15May 2, 2022Updated 4 years ago
- ☆15Apr 18, 2018Updated 8 years ago
- ☆13Mar 7, 2024Updated 2 years ago
- A very-minimal command-line parser☆20Jul 28, 2025Updated last year
- Jax/Flax rewrite of Karpathy's nanoGPT☆66Feb 15, 2023Updated 3 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- an openai chatbot that lets you talk to a git repository☆10Jul 27, 2024Updated 2 years ago