AI-Hypercomputer / jetstream-pytorch

Related projects ⓘ

Alternatives and complementary repositories for jetstream-pytorch

• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆74Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆229Updated this week
• google / saxml
  ☆121Updated this week
• apple / ml-recurrent-drafter
  ☆96Updated last month
• google / praxis
  ☆178Updated last week
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆98Updated last month
• AI-Hypercomputer / maxdiffusion
  ☆155Updated this week
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• rwitten / HighPerfLLMs2024
  ☆223Updated 4 months ago
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆80Updated this week
• character-ai / MuKoe
  ☆51Updated 6 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆160Updated last week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆144Updated this week
• GoogleCloudPlatform / ml-testing-accelerators
  Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)
  ☆64Updated 2 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated this week
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 3 months ago
• Sea-Snell / JAX_llama
  Inference code for LLaMA models in JAX
  ☆112Updated 5 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆132Updated 3 months ago
• google / aqt
  ☆262Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆63Updated last month
• google-deepmind / asyncdiloco
  ☆39Updated 9 months ago
• yifuwang / symm-mem-recipes
  ☆11Updated last month
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆163Updated this week
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆137Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆187Updated 3 weeks ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆133Updated 2 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆96Updated 3 weeks ago
• sholtodouglas / scalingExperiments
  ☆56Updated 2 years ago