Alternatives and similar repositories for xla:

Users that are interested in xla are comparing it to the libraries listed below

• iree-org / iree
  A retargetable MLIR-based machine learning compiler and runtime toolkit.
  ☆3,092Updated this week
• llvm / torch-mlir
  The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
  ☆1,491Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,251Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,116Updated last year
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…
  ☆2,346Updated this week
• facebookincubator / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆4,627Updated 2 weeks ago
• NVIDIA / cutlass
  CUDA Templates for Linear Algebra Subroutines
  ☆7,275Updated this week
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,039Updated 11 months ago
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆2,611Updated this week
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,944Updated this week
• google / flax
  Flax is a neural network library for JAX that is designed for flexibility.
  ☆6,470Updated this week
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆15,146Updated this week
• google / XNNPACK
  High-efficiency floating-point neural network inference operators for mobile, server, and Web
  ☆1,998Updated this week
• openxla / stablehlo
  Backward compatible ML compute opset inspired by HLO/MHLO
  ☆465Updated this week
• flexflow / flexflow-train
  Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
  ☆1,782Updated last week
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,216Updated 3 weeks ago
• dmlc / dlpack
  common in-memory tensor structure
  ☆974Updated this week
• intel / neural-compressor
  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…
  ☆2,369Updated this week
• ELS-RD / kernl
  Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…
  ☆1,564Updated last year
• onnx / onnx-mlir
  Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure
  ☆840Updated last week
• alpa-projects / alpa
  Training and serving large-scale neural networks with auto parallelization.
  ☆3,122Updated last year
• deepspeedai / DeepSpeed-MII
  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
  ☆1,999Updated 2 weeks ago
• NVIDIA / nccl
  Optimized primitives for collective multi-GPU communication
  ☆3,641Updated 3 weeks ago
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,582Updated this week
• apache / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆12,197Updated this week
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,293Updated this week
• NVIDIA / cccl
  CUDA Core Compute Libraries
  ☆1,591Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,293Updated last week
• merrymercy / awesome-tensor-compilers
  A list of awesome compiler projects and papers for tensor computation and deep learning.
  ☆2,536Updated 5 months ago
• mit-han-lab / llm-awq
  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  ☆2,912Updated 3 weeks ago