AI-Hypercomputer / kitharaLinks
☆16Updated 8 months ago
Alternatives and similar repositories for kithara
Users that are interested in kithara are comparing it to the libraries listed below
Sorting:
- ☆15Updated 8 months ago
- torchprime is a reference model implementation for PyTorch on TPU.☆44Updated last month
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last month
- ☆72Updated last week
- ☆124Updated last year
- ☆152Updated last month
- ☆192Updated 3 weeks ago
- ☆20Updated 2 years ago
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆162Updated this week
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆113Updated 3 months ago
- Fast, Modern, and Low Precision PyTorch Optimizers☆121Updated last month
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆33Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆87Updated 3 years ago
- ☆26Updated last month
- A set of Python scripts that makes your experience on TPU better☆56Updated 4 months ago
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆34Updated 11 months ago
- ☆63Updated 3 years ago
- Various transformers for FSDP research☆38Updated 3 years ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 8 months ago
- Official repo to On the Generalization Ability of Retrieval-Enhanced Transformers☆46Updated last year
- Google TPU optimizations for transformers models☆135Updated 2 weeks ago
- TPU inference for vLLM, with unified JAX and PyTorch support.☆228Updated this week
- Official implementation of "GPT or BERT: why not both?"☆61Updated 6 months ago
- A toolkit for scaling law research ⚖☆55Updated last year
- Pytorch/XLA SPMD Test code in Google TPU☆23Updated last year
- Two implementations of ZeRO-1 optimizer sharding in JAX☆14Updated 2 years ago
- A library for unit scaling in PyTorch☆133Updated 6 months ago
- ☆345Updated last week
- ☆66Updated 3 years ago
- ☆367Updated last year