Alternatives and similar repositories for LMBenchmark

Users that are interested in LMBenchmark are comparing it to the libraries listed below

• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆26Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆41Updated last month
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆38Updated 2 weeks ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆138Updated 11 months ago
• ProjectMitosisOS / mitosis-core
  An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).
  ☆63Updated 4 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆97Updated this week
• xinjin / course-net-seminar
  Selected Topics in Computer Networks @ Johns Hopkins University
  ☆19Updated 4 years ago
• bojieli / SocksDirect
  SocksDirect code repository
  ☆19Updated 3 years ago
• msr-fiddle / CoorDL
  ☆24Updated 2 years ago
• nnzhaocs / DupHunter
  ☆16Updated 4 years ago
• TUD-OS / migros-atc-2021
  Repository linking to the software artifacts used for the MigrOS ATC 2021 paper
  ☆17Updated 4 years ago
• nicexlab / GeminiFS
  GeminiFS: A Companion File System for GPUs
  ☆34Updated 4 months ago
• rkhan055 / SHADE
  SHADE: Enable Fundamental Cacheability for Distributed Deep Learning Training
  ☆35Updated 2 years ago
• uccl-project / uccl
  Ultra and Unified CCL
  ☆165Updated this week
• NTHU-LSALAB / Gemini
  An efficient GPU resource sharing system with fine-grained control for Linux platforms.
  ☆83Updated last year
• SJTU-IPADS / krcore-artifacts
  Ths is a fast RDMA abstraction layer that works both in the kernel and user-space.
  ☆56Updated 7 months ago
• checkpoint-restore / criu-coordinator
  A tool for coordinated checkpoint/restore of distributed applications with CRIU
  ☆25Updated last week
• Mellanox / ofed-docker
  ☆43Updated last year
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆78Updated last year
• bytedance-iaas / splitwise-demos
  ☆26Updated 3 months ago
• ds2-lab / infinistore
  InfiniStore: an elastic serverless cloud storage system (VLDB'23)
  ☆23Updated 2 years ago
• Azure / msccl-executor-nccl
  ☆37Updated 6 months ago
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆39Updated last week
• UWNetworksLab / meshinsight
  MeshInsight: Dissecting Overheads of Service Mesh Sidecars
  ☆47Updated last year
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆141Updated 5 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆123Updated last year
• Jeffwan / serverless-research
  Serverless Paper Reading and Discussion
  ☆37Updated 2 years ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated last year
• msr-fiddle / DS-Analyzer
  ☆37Updated 4 years ago
• abcdabcd987 / libfabric-efa-demo
  ☆39Updated 5 months ago