Alternatives and similar repositories for mlperf_client

Users that are interested in mlperf_client are comparing it to the libraries listed below

• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆226Updated 7 months ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆97Updated 3 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated 9 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆138Updated 7 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• tenstorrent / tt-smi
  Tenstorrent console based hardware information program
  ☆58Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last month
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 6 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆94Updated 10 months ago
• IST-DASLab / Quartet
  ☆117Updated 3 weeks ago
• intel / intel-ai-super-builder
  Intel® AI Super Builder
  ☆153Updated this week
• salykova / sgemm.cu
  High-Performance FP32 GEMM on CUDA devices
  ☆117Updated last year
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated last week
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆57Updated last year
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆113Updated last week
• ROCm / amdsmi
  AMD SMI
  ☆113Updated last week
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆158Updated 4 months ago
• amd / ryzen-ai-documentation
  Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…
  ☆91Updated last week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆74Updated 11 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 4 months ago
• apple / ml-recurrent-drafter
  ☆219Updated last year
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆59Updated last week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆344Updated last week
• amd / ZenDNN
  ☆135Updated last week
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆317Updated 2 months ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆112Updated last year
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆141Updated 3 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated last year
• cpldcpu / LRMTokenEconomy
  Measuring Thinking Efficiency in Reasoning Models - Research Repository
  ☆38Updated last month