erfanzar / EasyDeLLinks
Accelerate, Optimize performance with streamlined training and serving options with JAX.
☆325Updated this week
Alternatives and similar repositories for EasyDeL
Users that are interested in EasyDeL are comparing it to the libraries listed below
Sorting:
- JAX implementation of the Llama 2 model☆216Updated last year
- Inference code for LLaMA models in JAX☆120Updated last year
- ☆285Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆687Updated 3 weeks ago
- A set of Python scripts that makes your experience on TPU better☆54Updated 3 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆179Updated 5 months ago
- Fast bare-bones BPE for modern tokenizer training☆172Updated 5 months ago
- Minimal yet performant LLM examples in pure JAX☆214Updated 2 weeks ago
- seqax = sequence modeling + JAX☆169Updated 4 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated 2 years ago
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆297Updated last year
- JAX Synergistic Memory Inspector☆183Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆135Updated last year
- ☆225Updated 3 weeks ago
- Train very large language models in Jax.☆210Updated 2 years ago
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆32Updated 9 months ago
- Understand and test language model architectures on synthetic tasks.☆246Updated 2 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆243Updated 6 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆202Updated last year
- Cost aware hyperparameter tuning algorithm☆176Updated last year
- ☆91Updated last year
- A repository for research on medium sized language models.☆522Updated 6 months ago
- 🧱 Modula software package☆316Updated 4 months ago
- Load compute kernels from the Hub☆347Updated this week
- A simple library for scaling up JAX programs☆144Updated last month
- ☆547Updated last year
- Normalized Transformer (nGPT)☆193Updated last year
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆271Updated 3 weeks ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Minimal but scalable implementation of large language models in JAX☆35Updated 3 weeks ago