Alternatives and similar repositories for mlperf_client

Users that are interested in mlperf_client are comparing it to the libraries listed below

• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆221Updated 6 months ago
• intel / intel-ai-assistant-builder
  Intel® AI Assistant Builder
  ☆136Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆96Updated 2 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 6 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated this week
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 4 months ago
• apple / ml-recurrent-drafter
  ☆219Updated 10 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆200Updated 2 months ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆315Updated 2 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 9 months ago
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆56Updated last year
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆310Updated last month
• amd / ryzen-ai-documentation
  Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…
  ☆88Updated this week
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆24Updated last week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆398Updated this week
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆92Updated last week
• NVIDIA / RTX-AI-Toolkit
  The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…
  ☆180Updated 3 weeks ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated last year
• backprop-ai / vllm-benchmark
  Benchmarking the serving capabilities of vLLM
  ☆58Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆161Updated 3 weeks ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆228Updated last month
• spectral-compute / scale-examples
  ☆64Updated last year
• Cornell-RelaxML / yaqa-quantization
  ☆66Updated 6 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 10 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆144Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 10 months ago