Alternatives and similar repositories for llm-performance-tests

Users that are interested in llm-performance-tests are comparing it to the libraries listed below

• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆246Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 8 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆156Updated this week
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆177Updated 3 weeks ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆217Updated 6 months ago
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆185Updated 8 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆100Updated 7 months ago
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆232Updated 2 months ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆366Updated 6 months ago
• sam-paech / slop-forensics
  ☆304Updated 3 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆507Updated 2 weeks ago
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆206Updated 3 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• remichu-ai / gallama
  ☆134Updated 2 months ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆83Updated 2 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆170Updated 9 months ago
• notaDestroyer / vllm-benchmark-suite
  Benchmarking tool for vLLM inference performance with GPU monitoring
  ☆40Updated 2 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• intentee / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆79Updated last year
• vllm-project / vllm-metal
  Community maintained hardware plugin for vLLM on Apple Silicon
  ☆400Updated last week
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆258Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 2 weeks ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated this week
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆471Updated 2 weeks ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆401Updated 2 weeks ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆129Updated this week
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 7 months ago