modula-systems / modulaLinks
π§± Modula software package
β222Updated 3 weeks ago
Alternatives and similar repositories for modula
Users that are interested in modula are comparing it to the libraries listed below
Sorting:
- β275Updated last year
- supporting pytorch FSDP for optimizersβ84Updated 8 months ago
- Efficient optimizersβ254Updated 2 weeks ago
- Minimal yet performant LLM examples in pure JAXβ148Updated this week
- β208Updated 8 months ago
- LoRA for arbitrary JAX models and functionsβ141Updated last year
- seqax = sequence modeling + JAXβ166Updated last month
- Named Tensors for Legible Deep Learning in JAXβ201Updated this week
- A simple library for scaling up JAX programsβ143Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β152Updated last month
- A MAD laboratory to improve AI architecture designs π§ͺβ124Updated 8 months ago
- Minimal but scalable implementation of large language models in JAXβ35Updated last month
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditionβ¦β179Updated this week
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 secondsβ283Updated last month
- A library for unit scaling in PyTorchβ129Updated last month
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jaxβ643Updated this week
- An implementation of PSGD Kron second-order optimizer for PyTorchβ96Updated 3 weeks ago
- β115Updated 2 months ago
- β87Updated last year
- WIPβ94Updated last year
- nanoGPT-like codebase for LLM trainingβ102Updated 3 months ago
- If it quacks like a tensor...β58Updated 9 months ago
- Accelerated First Order Parallel Associative Scanβ187Updated last year
- Understand and test language model architectures on synthetic tasks.β221Updated last month
- JAX Synergistic Memory Inspectorβ178Updated last year
- Universal Tensor Operations in Einstein-Inspired Notation for Python.β399Updated 4 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT trainingβ130Updated last year
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvementβ¦β389Updated this week
- Dion optimizer algorithmβ291Updated last week
- Maximal Update Parametrization (ΞΌP) with Flax & Optax.β16Updated last year