Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 2 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BFloat16 Fused Adam Operator for PyTorch☆17Nov 16, 2024Updated last year
- Pruning is all you need (hopefully)☆12Sep 7, 2022Updated 3 years ago
- Minimal but scalable implementation of large language models in JAX☆35Nov 28, 2025Updated 3 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 9 months ago
- ☆21Apr 1, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆63Mar 4, 2022Updated 4 years ago
- ☆33Feb 4, 2026Updated last month
- Code for paper Evolving Connectivity for Spiking Neural Networks☆22Oct 23, 2023Updated 2 years ago
- ☆17Aug 16, 2019Updated 6 years ago
- Emacs 中看 B 站☆11Jul 27, 2025Updated 7 months ago
- Video face recognition and content creator collaboration detection framework.☆15Mar 24, 2023Updated 3 years ago
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆12Dec 3, 2023Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Wenet speech to text for react native☆10Nov 1, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆15May 11, 2025Updated 10 months ago
- NanoGPT (124M) in 5 minutes☆15Feb 14, 2025Updated last year
- Jax implementation of a flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm☆12Jan 29, 2025Updated last year
- A worker pool library for Rust☆12Oct 3, 2025Updated 5 months ago
- Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge☆10Aug 8, 2023Updated 2 years ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆107Feb 26, 2025Updated last year
- S3PRL for Speech Emotion Recognition (see s3prl > downstream)☆15Feb 28, 2026Updated 3 weeks ago
- SiteBlocker is a very simple little app designed to let you block sites from yourself. Enter regexes of the sites you want to block and i…☆10Jun 3, 2025Updated 9 months ago
- a minimalistic todo app☆10May 10, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An unnecessarily tiny and minimal implementation of GPT-2 in NumPy.☆11Feb 12, 2023Updated 3 years ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆342Updated this week
- General purpose benchmarking tool for turbopuffer deployments☆28Updated this week
- JAX bindings for the flash-attention3 kernels☆21Jan 2, 2026Updated 2 months ago
- Bookmark directories for easy directory-hopping in the terminal☆13Sep 10, 2025Updated 6 months ago
- Forced alignment decoder for Whisper.☆15Mar 13, 2024Updated 2 years ago
- For audio visualization and playback in Jupyter notebooks.☆17Nov 25, 2025Updated 4 months ago
- Sudoku solver in Golang☆10Sep 6, 2020Updated 5 years ago
- ☆15Apr 18, 2018Updated 7 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- Compute WER and SER for speech recognition evaluation☆27Mar 18, 2026Updated last week
- ☆13Mar 7, 2024Updated 2 years ago
- Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆15May 10, 2024Updated last year
- Command line tool for converting images to ASCII art☆20Oct 7, 2025Updated 5 months ago
- Rust powered background process CLI task manager☆14May 2, 2022Updated 3 years ago
- ☆27Oct 26, 2024Updated last year