Alternatives and similar repositories for skypilot-catalog

Users that are interested in skypilot-catalog are comparing it to the libraries listed below

• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆31Updated last month
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated last week
• google-deepmind / asyncdiloco
  ☆44Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆75Updated 3 weeks ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆41Updated 10 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆144Updated this week
• tyler-griggs / melange-release
  ☆46Updated 11 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆78Updated 3 months ago
• IST-DASLab / Quartet
  ☆46Updated last week
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 4 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 2 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆88Updated 2 weeks ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 6 months ago
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆21Updated 8 months ago
• snowflakedb / ArcticInference
  ☆99Updated last week
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆30Updated this week
• kevinwu23 / StanfordFineTuneBench
  ☆29Updated 6 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆112Updated 4 months ago
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆16Updated last month
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 7 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆61Updated 4 months ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆31Updated 2 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆66Updated 5 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆21Updated this week
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆36Updated last year