AI-Hypercomputer / maxtextLinks
A simple, performant and scalable Jax LLM!
☆1,932Updated this week
Alternatives and similar repositories for maxtext
Users that are interested in maxtext are comparing it to the libraries listed below
Sorting:
- Training LLMs with QLoRA + FSDP☆1,527Updated 11 months ago
- An Extensible Deep Learning Library☆2,271Updated this week
- ☆1,007Updated 8 months ago
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,415Updated this week
- A PyTorch native platform for training generative AI models☆4,561Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆987Updated last year
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,824Updated 4 months ago
- Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…☆1,296Updated 2 months ago
- Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.☆685Updated last year
- Tile primitives for speedy kernels☆2,821Updated last week
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆539Updated last month
- Open weights language model from Google DeepMind, based on Griffin.☆652Updated 4 months ago
- PyTorch native quantization and sparsity for training and inference☆2,438Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,128Updated 2 months ago
- A modern model graph visualizer and debugger☆1,325Updated this week
- ☆541Updated last year
- Puzzles for learning Triton☆2,036Updated 11 months ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆384Updated 4 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆989Updated 5 months ago
- Minimalistic large language model 3D-parallelism training☆2,267Updated last month
- ☆446Updated last year
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,610Updated this week
- What would you do with 1000 H100s...☆1,113Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆671Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆578Updated 2 months ago
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,610Updated 11 months ago
- NanoGPT (124M) in 3 minutes☆3,565Updated last week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,856Updated last month
- ☆2,542Updated last year
- Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch☆1,883Updated 2 weeks ago