Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 3 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 9 months ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year
- ☆62Mar 4, 2022Updated 4 years ago
- 本项目主要对开源的MOSS SFT数据进行整理 ，转换成mnbvc多轮对话格式。MOSS-003涵盖用性、忠实性、无害性三个层面，共353w样本，MOSS-003 包含更细粒度的有用性类别标记、更广泛的无害性数据和更长对话轮数，共630w样本，☆13Dec 3, 2023Updated 2 years ago
- Jax implementation of a flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm☆13Jan 29, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Range-based algorithms in Go☆14Sep 10, 2023Updated 3 years ago
- a WIP architecture designed to allow transformers to think in a manner without tokens☆19Apr 12, 2024Updated 2 years ago
- Maze generation and plotting using recursive backtracking☆10Jul 11, 2023Updated 3 years ago
- Library for encrypt and decrypt using RSA public and private key☆12Sep 23, 2018Updated 8 years ago
- NanoGPT (124M) in 5 minutes☆16Feb 14, 2025Updated last year
- A worker pool library for Rust☆13Jul 27, 2026Updated last month
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…☆17Nov 11, 2024Updated last year
- Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge☆10Aug 8, 2023Updated 3 years ago
- Have UV deal with all your Jupyter deps.☆29Sep 7, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- S3PRL for Speech Emotion Recognition (see s3prl > downstream)☆15Feb 28, 2026Updated 6 months ago
- Gold draws from Monkey, the language featured in Thorsten Ball's books. While initially following its guidelines, Gold has (slightly) evo…☆10Jun 13, 2024Updated 2 years ago
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆374Sep 15, 2026Updated last week
- ☆15May 11, 2025Updated last year
- Forced alignment decoder for Whisper.☆16Mar 13, 2024Updated 2 years ago
- Sudoku solver in Golang☆10Sep 6, 2020Updated 6 years ago
- Command line tool for converting images to ASCII art☆20Jun 4, 2026Updated 3 months ago
- Lightning-like training API for JAX with Flax☆45Dec 8, 2024Updated last year
- Rust powered background process CLI task manager☆15May 2, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆13Mar 7, 2024Updated 2 years ago
- Neovim Dotfiles☆12Jun 14, 2026Updated 3 months ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- an openai chatbot that lets you talk to a git repository☆10Jul 27, 2024Updated 2 years ago
- ☆94Jul 5, 2024Updated 2 years ago
- Repository for learning a policy to get a humanoid robot to stand up☆20Feb 13, 2025Updated last year
- Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆16May 10, 2024Updated 2 years ago
- Reinforcement learning in pure JAX.☆15Jun 24, 2026Updated 2 months ago
- asynchronous code formatting plugin☆16Jul 26, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Apr 26, 2025Updated last year
- Learn Swift and Kotlin from beginner to advanced in parallel by giving the same examples.☆14Oct 22, 2017Updated 8 years ago
- replacement of AdamW and Lion optimizer for LLMs☆13May 28, 2023Updated 3 years ago
- ☆12Mar 19, 2022Updated 4 years ago
- Produce intelligence by means of natural selection without objective/reward optimization☆16Sep 29, 2021Updated 4 years ago
- An Ensemble of Bayesian Neural Networks for Exoplanetary Atmospheric Retrieval☆12Feb 26, 2019Updated 7 years ago
- A Python library for management of configuration settings in TOML format across various applications.☆13Jul 14, 2024Updated 2 years ago