Two implementations of ZeRO-1 optimizer sharding in JAX
☆14Jun 11, 2023Updated 3 years ago
Alternatives and similar repositories for ZeRO-transformer
Users that are interested in ZeRO-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- ☆16Feb 6, 2024Updated 2 years ago
- Pruning is all you need (hopefully)☆12Sep 7, 2022Updated 4 years ago
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 11 months ago
- Hyperbolic decision trees☆14Jun 6, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- Structured Generation Evals☆14Sep 25, 2024Updated 2 years ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year
- ☆12Mar 21, 2024Updated 2 years ago
- Code for paper Evolving Connectivity for Spiking Neural Networks☆23Oct 23, 2023Updated 3 years ago
- Train an LLM to generate cracked Manim animations for mathematical concepts.☆23Mar 14, 2025Updated last year
- ☆95Jul 5, 2024Updated 2 years ago
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- SiteBlocker is a very simple little app designed to let you block sites from yourself. Enter regexes of the sites you want to block and i…☆10Jun 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pluralsight Reporting API - Python Client☆11Apr 13, 2017Updated 9 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Range-based algorithms in Go☆14Sep 10, 2023Updated 3 years ago
- Wenet speech to text for react native☆10Nov 1, 2022Updated 4 years ago
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Jul 10, 2020Updated 6 years ago
- Jax implementation of a flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm☆13Jan 29, 2025Updated last year
- Semantic Scaffolds for Pseudocode-to-Code Generation (accepted by ACL 2020)☆14Jun 7, 2021Updated 5 years ago
- Porting the Darwin kernel to the AArch64/ARMv7/ARMv6-A architectures.☆13Oct 8, 2026Updated 3 weeks ago
- ☆11Sep 20, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Three generic heap implementations in C☆12Jul 3, 2023Updated 3 years ago
- A replication of the paper "Adaptive Mixtures of Local Experts" applied to the CIFAR-10 image classification dataset.☆12Mar 19, 2021Updated 5 years ago
- ☆11Sep 8, 2025Updated last year
- ☆26Sep 3, 2024Updated 2 years ago
- Traceable TTS: Toward Watermark-Free TTS with Strong Traceability☆13Sep 4, 2025Updated last year
- Code and data for AAAI 2022 paper "Multilingual Code Snippets Training for Program Translation"☆10Mar 7, 2022Updated 4 years ago
- Exact biosequence alignment and folding on GPUs — Needleman-Wunsch, Smith-Waterman, Levenshtein, Zuker, and Sankoff with Gotoh adjustment…☆34Oct 5, 2026Updated 3 weeks ago
- ☆17Sep 24, 2026Updated last month
- ☆14Dec 13, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Repository for the 2023 NeurIPS paper "Scaling laws for language encoding models in fMRI"☆26May 30, 2024Updated 2 years ago
- ☆14May 26, 2020Updated 6 years ago
- A text classification and similairty computing project in Python.We have tried wordbag,word2vec,WordMoverDistance,N-gram,LSTM,C-LSTM, LST…☆11May 18, 2019Updated 7 years ago
- ☆10Oct 27, 2023Updated 3 years ago
- an openai chatbot that lets you talk to a git repository☆10Jul 27, 2024Updated 2 years ago
- ☆13May 15, 2026Updated 5 months ago
- An unnecessarily tiny and minimal implementation of GPT-2 in NumPy.☆11Feb 12, 2023Updated 3 years ago