HomebrewNLP in JAX flavour for maintable TPU-Training
☆50Jan 20, 2024Updated 2 years ago
Alternatives and similar repositories for Olmax
Users that are interested in Olmax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A case study of efficient training of large language models using commodity hardware.☆67Aug 4, 2022Updated 3 years ago
- Your fruity companion for transformers☆14May 25, 2022Updated 4 years ago
- Automatically take good care of your preemptible TPUs☆37May 15, 2023Updated 3 years ago
- RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network☆15Oct 18, 2022Updated 3 years ago
- ☆16Jul 16, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Reimplementation of `Improving language models by retrieving from trillions of tokens`☆19Nov 16, 2022Updated 3 years ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- Train vision models using JAX and 🤗 transformers☆103Dec 14, 2025Updated 6 months ago
- One stop shop for all things carp☆58Sep 9, 2022Updated 3 years ago
- ☆15Jun 8, 2026Updated 3 weeks ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Aug 6, 2021Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆198May 30, 2026Updated 3 weeks ago
- PyTorch interface for TrueGrad Optimizers☆43Aug 8, 2023Updated 2 years ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆80May 30, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆21Oct 6, 2023Updated 2 years ago
- Train a bidirectional or normal LSTM recurrent neural network to generate text on a free GPU using any dataset. Just upload your text fil…☆12Jan 29, 2019Updated 7 years ago
- Benchmark scripts for comparing tutorials in PyTorch and JAX☆14Aug 25, 2022Updated 3 years ago
- Extracting minimal DFA's from well-trained RNN's☆11Nov 26, 2018Updated 7 years ago
- Modular optimization library for PyTorch (work-in-progress).☆13Feb 4, 2026Updated 4 months ago
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆31Mar 18, 2026Updated 3 months ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Unified API to facilitate usage of pre-trained "perceptor" models, a la CLIP☆39Nov 26, 2022Updated 3 years ago
- This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-…☆14Dec 12, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of GateLoop Transformer in Pytorch and Jax☆92Jun 18, 2024Updated 2 years ago
- Implementation of Kronecker Attention in Pytorch☆20Sep 12, 2020Updated 5 years ago
- Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency☆25Jul 31, 2024Updated last year
- High-performance tokenized language data-loader for Python C++ extension☆15Jul 22, 2024Updated last year
- Focused on fast experimentation and simplicity☆79Dec 24, 2024Updated last year
- ☆29Jul 9, 2024Updated last year
- Implementation of PSGD optimizer in JAX☆35Dec 31, 2024Updated last year
- Simple implementation of V-MPO proposed in https://arxiv.org/abs/1909.12238☆48Nov 10, 2020Updated 5 years ago
- Multi-agent simulator in Jax for research and teaching in AI & ALife☆31Apr 11, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- jax-triton contains integrations between JAX and OpenAI Triton☆465Updated this week
- Pytorch-like dataloaders for JAX.☆104Dec 16, 2025Updated 6 months ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Jul 28, 2022Updated 3 years ago
- Scripts for downloading and pre-processing the `proof-pile`, a high quality dataset of mathematical text and code.☆22Nov 26, 2022Updated 3 years ago
- Train very large language models in Jax.☆208Oct 21, 2023Updated 2 years ago
- A simple strategy for training and finetuning NLP models for Arabic. Specify the parameters and just wait for the results. A simple desig…☆21Jan 27, 2024Updated 2 years ago
- Easily turn large sets of audio urls to an audio dataset.☆21Dec 27, 2022Updated 3 years ago