Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.
☆27Sep 29, 2024Updated last year
Alternatives and similar repositories for midGPT
Users that are interested in midGPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 9 months ago
- Einsum-like high-level array sharding API for JAX☆35Jul 16, 2024Updated 2 years ago
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆20Sep 24, 2025Updated last year
- ☆15Aug 21, 2026Updated last month
- ☆27Jul 9, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Julia package interfacing the Fortran code MPBNGC.☆13Jun 28, 2025Updated last year
- Official repo of dataset-decomposition paper [NeurIPS 2024]☆21Sep 11, 2026Updated 2 weeks ago
- ☆19Jun 23, 2023Updated 3 years ago
- Frechet inception distance (FID) evaluation in JAX☆14May 28, 2024Updated 2 years ago
- A JAX implementation of stochastic addition.☆13Aug 15, 2022Updated 4 years ago
- Tensor Parallelism with JAX + Shard Map☆11Sep 29, 2023Updated 2 years ago
- NumPy+Jax with named axes and an uncompromising attitude☆23Mar 4, 2025Updated last year
- Make triton easier☆49Sep 3, 2026Updated 3 weeks ago
- Code and data for automatic paraphrase dataset augmentation.☆11Mar 8, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆38Dec 3, 2023Updated 2 years ago
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 5 months ago
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Oct 11, 2024Updated last year
- [COLING 2022]: CommunityLM: Probing Partisan Worldviews from Language Models☆14Jan 31, 2023Updated 3 years ago
- A Python Package for Portfolio Optimization using the Critical Line Algorithm☆27Aug 1, 2023Updated 3 years ago
- ☆306Jul 15, 2024Updated 2 years ago
- An implementation of the Llama architecture, to instruct and delight☆21May 31, 2025Updated last year
- Source code for my PhD thesis: Backpropagation Beyond the Gradient☆21Feb 25, 2023Updated 3 years ago
- Train very large language models in Jax.☆208Oct 21, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Blazingly fast implementation of the Datasaurus paper. Same Stats, Different Graphs.☆19Mar 22, 2026Updated 6 months ago
- Code and data for paper "(How) do Language Models Track State?"☆29Mar 31, 2025Updated last year
- Jatmos is a scalable simulator for atmospheric dynamics, written in JAX.☆38Apr 21, 2025Updated last year
- When you need just a little more than standard typing. (Probably the #1 library with the highest downloads/star ratio!✨)☆25Aug 5, 2021Updated 5 years ago
- High-performance tokenized language data-loader for Python C++ extension☆15Jul 22, 2024Updated 2 years ago
- YouTube Assistant☆12May 15, 2023Updated 3 years ago
- ☆18May 28, 2021Updated 5 years ago
- A small library for creating and manipulating custom JAX Pytree classes☆56Feb 26, 2023Updated 3 years ago
- JAX implementation of the Llama 2 model☆217Feb 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Named Tensors for Legible Deep Learning in JAX☆231Sep 1, 2026Updated 3 weeks ago
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12May 24, 2023Updated 3 years ago
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆175Nov 11, 2025Updated 10 months ago
- [ICML 2026] RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments☆235Apr 30, 2026Updated 4 months ago
- Exponential families for JAX☆77Sep 18, 2026Updated last week
- Gaussian Markov Random Fields (GMRFs) and Integrated Nested Laplace Approximation (INLA)☆24Apr 17, 2024Updated 2 years ago
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago