Alternatives and similar repositories for mlperf_client

Users that are interested in mlperf_client are comparing it to the libraries listed below

• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆227Updated 7 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆68Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆138Updated 8 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆97Updated 3 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆203Updated 4 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 6 months ago
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆318Updated 2 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆94Updated 11 months ago
• intel / intel-ai-super-builder
  Intel® AI Super Builder
  ☆156Updated last week
• mozilla-ai / agent.cpp
  Building blocks for agents in C++
  ☆139Updated last week
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆173Updated 3 weeks ago
• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆590Updated 3 weeks ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆161Updated 4 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆168Updated 2 weeks ago
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆317Updated 4 months ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated this week
• salykova / sgemm.cu
  High-Performance FP32 GEMM on CUDA devices
  ☆117Updated last year
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆287Updated 3 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆352Updated last year
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆74Updated last year
• IST-DASLab / Quartet
  ☆118Updated last month
• IBM / analog-foundation-models
  Code for paper "Analog Foundation Models"
  ☆30Updated 4 months ago
• apple / ml-recurrent-drafter
  ☆219Updated last year
• LambdaLabsML / llama
  Inference code for LLaMA models
  ☆41Updated 2 years ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated last week
• Libraries-Openly-Fused / FusedKernelLibrary
  We aim to redefine Data Parallel libraries portabiliy, performance, programability and maintainability, by using C++ standard features, i…
  ☆47Updated this week
• backprop-ai / vllm-benchmark
  Benchmarking the serving capabilities of vLLM
  ☆59Updated last year
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆58Updated 4 months ago