sholtodouglas / minformer
Minimal transformer for arbtirary data (i.e. bio stuff!)
☆21Updated 2 months ago
Alternatives and similar repositories for minformer:
Users that are interested in minformer are comparing it to the libraries listed below
- seqax = sequence modeling + JAX☆143Updated 7 months ago
- Simple Transformer in Jax☆136Updated 8 months ago
- Minimal but scalable implementation of large language models in JAX☆32Updated 3 months ago
- ☆211Updated 7 months ago
- A simple library for scaling up JAX programs☆129Updated 3 months ago
- Solve puzzles. Learn CUDA.☆62Updated last year
- A set of Python scripts that makes your experience on TPU better☆48Updated 7 months ago
- Train very large language models in Jax.☆203Updated last year
- Implementation of Diffusion Transformer (DiT) in JAX☆265Updated 8 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆103Updated 2 months ago
- supporting pytorch FSDP for optimizers☆76Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆95Updated 3 months ago
- Implementation of PSGD optimizer in JAX☆28Updated last month
- WIP☆93Updated 6 months ago
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆59Updated 2 months ago
- JAX bindings for Flash Attention v2☆85Updated 7 months ago
- ☆377Updated 7 months ago
- Cost aware hyperparameter tuning algorithm☆143Updated 7 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆118Updated last year
- LoRA for arbitrary JAX models and functions☆135Updated 11 months ago
- A puzzle to learn about prompting☆124Updated last year
- ☆58Updated 2 years ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆56Updated 2 years ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆122Updated 10 months ago
- ☆73Updated 3 months ago
- Benchmarking Agentic LLM and VLM Reasoning On Games☆115Updated this week
- Custom triton kernels for training Karpathy's nanoGPT.☆16Updated 4 months ago
- JAX implementation of the Llama 2 model☆215Updated last year
- Efficient baselines for autocurricula in JAX.☆179Updated 5 months ago