Alternatives and similar repositories for mlperf_client

Users that are interested in mlperf_client are comparing it to the libraries listed below

• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆221Updated 7 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆96Updated 2 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated last week
• intel / intel-ai-assistant-builder
  Intel® AI Assistant Builder
  ☆140Updated this week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 7 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆94Updated 10 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆330Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated last year
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆153Updated 3 months ago
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆57Updated last year
• IST-DASLab / Quartet
  ☆114Updated last week
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 5 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆135Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆219Updated 11 months ago
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆113Updated last week
• deepreinforce-ai / CUDA-L2
  CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
  ☆294Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 3 weeks ago
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated 9 months ago
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆58Updated 3 months ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆94Updated last month
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆312Updated last month
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆96Updated this week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆66Updated 3 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆115Updated 11 months ago
• google-ai-edge / LiteRT-LM
  ☆690Updated last week
• gpu-mode / popcorn-cli
  ☆83Updated last month
• IBM / analog-foundation-models
  Code for paper "Analog Foundation Models"
  ☆27Updated 3 months ago