Alternatives and similar repositories for skypilot-catalog

Users that are interested in skypilot-catalog are comparing it to the libraries listed below

• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆33Updated 5 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 7 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆57Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 8 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 8 months ago
• google-deepmind / asyncdiloco
  ☆46Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆218Updated this week
• pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆404Updated last week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆287Updated this week
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆244Updated this week
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆147Updated this week
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated 9 months ago
• apple / ml-recurrent-drafter
  ☆217Updated 8 months ago
• tilde-research / MoMoE-impl
  Memory optimized Mixture of Experts
  ☆65Updated 2 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆58Updated last year
• NVIDIA-NeMo / Automodel
  DTensor-native pretraining and fine-tuning for LLMs/VLMs with day-0 Hugging Face support, GPU-acceleration, and memory efficiency.
  ☆81Updated this week
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆138Updated 7 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 7 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated 11 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆212Updated last week
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆129Updated 9 months ago
• meta-pytorch / monarch
  PyTorch Single Controller
  ☆423Updated this week
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆266Updated 11 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆152Updated 11 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆41Updated this week