Alternatives and similar repositories for optimum-tpu

Users that are interested in optimum-tpu are comparing it to the libraries listed below

• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆60Updated 2 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆139Updated this week
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆98Updated this week
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆263Updated 7 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• HeegyuKim / torch-xla-SPMD
  Pytorch/XLA SPMD Test code in Google TPU
  ☆23Updated last year
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆67Updated last month
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆249Updated this week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆257Updated 10 months ago
• IST-DASLab / Quartet
  ☆46Updated last week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆334Updated this week
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆23Updated 3 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• mgmalek / efficient_cross_entropy
  ☆108Updated last year
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• unslothai / unsloth-zoo
  Utils for Unsloth
  ☆90Updated this week
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆53Updated 10 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 2 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 5 months ago
• cloneofsimo / min-fsdp
  ☆78Updated 10 months ago
• huggingface / picotron_tutorial
  ☆188Updated 3 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆41Updated 3 months ago
• snowflakedb / ArcticInference
  ☆99Updated this week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• erfanzar / EasyDeL
  Accelerate, Optimize performance with streamlined training and serving options with JAX.
  ☆274Updated this week
• arcee-ai / DAM
  ☆49Updated 6 months ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆93Updated 10 months ago