Alternatives and similar repositories for llm-speed-benchmark

Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• IBM / vllm
  vLLM with support for span semantics
  ☆21Updated last month
• groq / realtime-eval
  Realtime News and Information Eval
  ☆16Updated 2 months ago
• nhtlongcs / StarListify
  StarListify is a Python package that classifies GitHub stars history into organized category lists based on user-defined criteria.
  ☆33Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated last year
• irthomasthomas / undecidability
  ☆24Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• llmonpy / needle-in-a-needlestack
  ☆115Updated 11 months ago
• bigcode-project / opt-out-v2
  Repository for opt-out requests.
  ☆10Updated last year
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆239Updated last year
• fixie-ai / llm-frameworks
  ☆19Updated last year
• GammaTauAI / opentau
  Using Large Language Models for Repo-wide Type Prediction
  ☆114Updated 2 years ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated 2 years ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated 11 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆84Updated last year
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆18Updated 2 years ago
• ErikKaum / runner
  Experimental wasm32-unknown-wasi runtime for Python code execution
  ☆40Updated last year
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆30Updated last year
• ray-project / llmperf-leaderboard
  ☆477Updated 2 years ago
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆154Updated 2 years ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆17Updated 7 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated this week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆46Updated 2 weeks ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• 9600dev / llmvm
  LLM <-> Python agentic runtime prototype
  ☆114Updated 5 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 11 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆94Updated 10 months ago
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago