AI-Hypercomputer / kitharaLinks
☆16Updated 7 months ago
Alternatives and similar repositories for kithara
Users that are interested in kithara are comparing it to the libraries listed below
Sorting:
- torchprime is a reference model implementation for PyTorch on TPU.☆43Updated 2 months ago
- ☆15Updated 7 months ago
- ☆64Updated this week
- ☆148Updated last month
- ☆121Updated last year
- ☆26Updated this week
- Various transformers for FSDP research☆38Updated 3 years ago
- Google TPU optimizations for transformers models☆131Updated last week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last week
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆112Updated last month
- Pytorch/XLA SPMD Test code in Google TPU☆23Updated last year
- Load compute kernels from the Hub☆352Updated last week
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆155Updated this week
- some common Huggingface transformers in maximal update parametrization (µP)☆87Updated 3 years ago
- ☆190Updated last week
- An implementation of the Llama architecture, to instruct and delight☆21Updated 6 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆275Updated last month
- ☆20Updated 2 years ago
- Fast, Modern, and Low Precision PyTorch Optimizers☆118Updated 3 months ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆74Updated last year
- A library for unit scaling in PyTorch☆133Updated 5 months ago
- TPU inference for vLLM, with unified JAX and PyTorch support.☆202Updated this week
- Official code release for "SuperBPE: Space Travel for Language Models"☆77Updated last month
- A set of Python scripts that makes your experience on TPU better☆55Updated 3 months ago
- ☆91Updated last year
- ☆340Updated 2 weeks ago
- ☆110Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆217Updated 2 weeks ago
- A toolkit for scaling law research ⚖☆53Updated 11 months ago
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆33Updated 10 months ago