Alternatives and similar repositories for LMBenchmark

Users that are interested in LMBenchmark are comparing it to the libraries listed below

• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆36Updated 3 weeks ago
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆36Updated 2 weeks ago
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆31Updated 2 weeks ago
• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆19Updated last week
• NTHU-LSALAB / Gemini
  An efficient GPU resource sharing system with fine-grained control for Linux platforms.
  ☆83Updated last year
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆96Updated 2 months ago
• checkpoint-restore / criu-coordinator
  A tool for coordinated checkpoint/restore of distributed applications with CRIU
  ☆22Updated this week
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆30Updated 5 months ago
• intel / memtierd
  ☆30Updated last month
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆47Updated last week
• CentaurusInfra / alnair
  Intelligent platform for AI workloads
  ☆37Updated 2 years ago
• k8snetworkplumbingwg / rdma-cni
  RDMA CNI plugin for containerized workloads
  ☆52Updated 3 weeks ago
• intel / goresctrl
  Golang library for managing resctrl filesystem
  ☆48Updated 8 months ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆75Updated 11 months ago
• xinjin / course-net-seminar
  Selected Topics in Computer Networks @ Johns Hopkins University
  ☆19Updated 4 years ago
• Mellanox / ofed-docker
  ☆42Updated last year
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆92Updated last week
• k82cn / kubesim
  A simulator of Kuberntes for batch and service workload.
  ☆46Updated 4 years ago
• containers / nydus-storage-plugin
  A storage plugin that provided CRI-O/Podman with the ability to lazy mount nydus images.
  ☆39Updated 3 weeks ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆67Updated last month
• ProjectMitosisOS / mitosis-core
  An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).
  ☆63Updated 3 months ago
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆45Updated this week
• tkestack / go-nvml
  ☆31Updated 3 years ago
• TUD-OS / migros-atc-2021
  Repository linking to the software artifacts used for the MigrOS ATC 2021 paper
  ☆17Updated 4 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆121Updated last year
• SJTU-IPADS / krcore-artifacts
  Ths is a fast RDMA abstraction layer that works both in the kernel and user-space.
  ☆56Updated 6 months ago
• k8snetworkplumbingwg / ib-sriov-cni
  InfiniBand SR-IOV CNI
  ☆49Updated this week
• Mellanox / ib-kubernetes
  ☆62Updated last week
• heyfey / vodascheduler
  GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)
  ☆34Updated last year
• Tintri / hello-bench
  A startup benchmarking tool for Docker containers.
  ☆70Updated 9 years ago