Alternatives and similar repositories for kithara

Users that are interested in kithara are comparing it to the libraries listed below

• AI-Hypercomputer / torchprime
  torchprime is a reference model implementation for PyTorch on TPU.
  ☆44Updated last week
• google / saxml
  ☆151Updated last week
• AI-Hypercomputer / ray-tpu
  ☆15Updated 8 months ago
• AI-Hypercomputer / tpu-recipes
  ☆69Updated last week
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆79Updated last month
• mgmalek / efficient_cross_entropy
  ☆124Updated last year
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆159Updated this week
• google / praxis
  ☆192Updated this week
• AI-Hypercomputer / cloud-accelerator-diagnostics
  ☆26Updated 3 weeks ago
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆400Updated last week
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆113Updated 2 months ago
• vllm-project / tpu-inference
  TPU inference for vLLM, with unified JAX and PyTorch support.
  ☆213Updated this week
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆133Updated 6 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆278Updated last month
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆278Updated 3 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Updated 3 years ago
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆469Updated this week
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆38Updated 3 years ago
• cat-state / tinypar
  ☆20Updated 2 years ago
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆119Updated 2 weeks ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆55Updated 4 months ago
• google / paxml
  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…
  ☆544Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆359Updated last week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆132Updated 3 weeks ago
• google / aqt
  ☆342Updated last week
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆227Updated last year
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆33Updated 11 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆218Updated this week
• TobiasNorlund / retro
  Official repo to On the Generalization Ability of Retrieval-Enhanced Transformers
  ☆46Updated last year
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆55Updated 11 months ago