Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 3 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of Refine and Represent: Region-to-Object Representation Learning.☆21Jun 19, 2025Updated last year
- [AAAI'25 Oral] Are Expressive Models Truly Necessary for Offline RL?☆15Dec 10, 2024Updated last year
- Pruning is all you need (hopefully)☆12Sep 7, 2022Updated 3 years ago
- Structured Generation Evals☆14Sep 25, 2024Updated last year
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Less-wrong single-file Numba-accelerated Python implementation of Gotoh affine gap penalty extensions for the Needleman–Wunsch, Smith-Wat…☆14Jun 15, 2026Updated last month
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆31Jun 5, 2025Updated last year
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- ☆30Oct 26, 2024Updated last year
- One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework☆21Oct 25, 2023Updated 2 years ago
- Code for paper Evolving Connectivity for Spiking Neural Networks☆22Oct 23, 2023Updated 2 years ago
- ☆62Mar 4, 2022Updated 4 years ago
- ☆17Aug 16, 2019Updated 6 years ago
- Pluralsight Reporting API - Python Client☆11Apr 13, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆13Dec 3, 2023Updated 2 years ago
- Range-based algorithms in Go☆14Sep 10, 2023Updated 2 years ago
- SiteBlocker is a very simple little app designed to let you block sites from yourself. Enter regexes of the sites you want to block and i…☆10Jun 3, 2025Updated last year
- Ray Tracer written in Rust☆13Nov 22, 2021Updated 4 years ago
- NanoGPT (124M) in 5 minutes☆16Feb 14, 2025Updated last year
- A worker pool library for Rust☆13Updated this week
- ☆12Oct 9, 2025Updated 9 months ago
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…☆17Nov 11, 2024Updated last year
- Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge☆10Aug 8, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆110Feb 26, 2025Updated last year
- ☆40Updated this week
- ☆14May 26, 2020Updated 6 years ago
- Have UV deal with all your Jupyter deps.☆29Sep 7, 2024Updated last year
- S3PRL for Speech Emotion Recognition (see s3prl > downstream)☆15Feb 28, 2026Updated 4 months ago
- An unnecessarily tiny and minimal implementation of GPT-2 in NumPy.☆11Feb 12, 2023Updated 3 years ago
- a minimalistic todo app☆10May 10, 2023Updated 3 years ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆368Updated this week
- writing really fast kernels☆19Jul 15, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Bookmark directories for easy directory-hopping in the terminal☆14Sep 10, 2025Updated 10 months ago
- ☆15May 11, 2025Updated last year
- Sudoku solver in Golang☆10Sep 6, 2020Updated 5 years ago
- Command line tool for converting images to ASCII art☆20Jun 4, 2026Updated last month
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- ☆15Apr 18, 2018Updated 8 years ago
- Rust powered background process CLI task manager☆15May 2, 2022Updated 4 years ago