Alternatives and similar repositories for llm-d-inference-sim

Users that are interested in llm-d-inference-sim are comparing it to the libraries listed below

• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆56Updated this week
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆15Updated 2 weeks ago
• checkpoint-restore / criu-coordinator
  A tool for coordinated checkpoint/restore of distributed applications with CRIU
  ☆23Updated 3 weeks ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆30Updated 5 months ago
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆35Updated this week
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆36Updated last week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆39Updated last month
• intel / memtierd
  ☆30Updated last month
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆98Updated 2 months ago
• bytedance-iaas / splitwise-demos
  ☆26Updated 3 months ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆67Updated last month
• Jeffwan / serverless-research
  Serverless Paper Reading and Discussion
  ☆37Updated 2 years ago
• llm-d / llm-d-model-service
  Simplified model deployment on llm-d
  ☆24Updated 2 weeks ago
• kubernetes-sigs / dra-example-driver
  Example DRA driver that developers can fork and modify to get them started writing their own.
  ☆74Updated last month
• NTHU-LSALAB / Gemini
  An efficient GPU resource sharing system with fine-grained control for Linux platforms.
  ☆83Updated last year
• eunomia-bpf / eGPU
  Extending eBPF Programmability and Observability to GPUs (merged into https://github.com/eunomia-bpf/bpftime)
  ☆58Updated 3 weeks ago
• ProjectMitosisOS / mitosis-core
  An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).
  ☆63Updated 4 months ago
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆116Updated last year
• ds2-lab / FaaSNet
  FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function Compute (USENIX ATC'21)
  ☆55Updated 3 years ago
• heyfey / vodascheduler
  GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)
  ☆34Updated last year
• intel / platform-aware-scheduling
  Enabling Kubernetes to make pod placement decisions with platform intelligence.
  ☆175Updated 4 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆58Updated this week
• stonet-research / cheops25-IO-characterization-of-LLM-model-kv-cache-offloading-nvme
  ☆11Updated 2 months ago
• CentaurusInfra / alnair
  Intelligent platform for AI workloads
  ☆37Updated 2 years ago
• NVIDIA / go-gpuallocator
  Go Abstraction for Allocating NVIDIA GPUs with Custom Policies
  ☆113Updated this week
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆97Updated this week
• sjtu-sail / seminar
  The schedule of the seminar
  ☆25Updated 3 years ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆76Updated last year
• ucsdsysnet / faasnap
  ☆28Updated 3 years ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated last year