erfanzar / EasyDeLLinks
Accelerate, Optimize performance with streamlined training and serving options with JAX.
☆336Updated last week
Alternatives and similar repositories for EasyDeL
Users that are interested in EasyDeL are comparing it to the libraries listed below
Sorting:
- JAX implementation of the Llama 2 model☆216Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆693Updated 2 weeks ago
- ☆291Updated last year
- Understand and test language model architectures on synthetic tasks.☆252Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆187Updated 3 weeks ago
- seqax = sequence modeling + JAX☆170Updated 6 months ago
- A set of Python scripts that makes your experience on TPU better☆56Updated 4 months ago
- Minimal yet performant LLM examples in pure JAX☆240Updated 3 weeks ago
- Inference code for LLaMA models in JAX☆120Updated last year
- ☆232Updated 2 months ago
- Cost aware hyperparameter tuning algorithm☆179Updated last year
- 🧱 Modula software package☆322Updated 5 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆86Updated 2 years ago
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆34Updated 11 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆138Updated last year
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆300Updated last year
- MoE training for Me and You and maybe other people☆353Updated this week
- Fast bare-bones BPE for modern tokenizer training☆175Updated 7 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆248Updated 8 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆204Updated last year
- LoRA for arbitrary JAX models and functions☆145Updated last year
- Efficient optimizers☆281Updated last month
- JAX Synergistic Memory Inspector☆184Updated last year
- ☆192Updated last week
- Load compute kernels from the Hub☆397Updated last week
- Train very large language models in Jax.☆210Updated 2 years ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆280Updated 2 months ago
- nanoGPT-like codebase for LLM training☆113Updated 3 months ago
- Normalized Transformer (nGPT)☆198Updated last year
- supporting pytorch FSDP for optimizers☆84Updated last year