Alternatives and similar repositories for llm-inference-simulator

Users that are interested in llm-inference-simulator are comparing it to the libraries listed below

• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆50Updated last week
• simon-mo / vLLM-Benchmark
  ☆31Updated 9 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 10 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 11 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆28Updated 2 years ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 4 years ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆18Updated last year
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated last year
• UbiquitousLearning / SLM_Survey
  ☆102Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆61Updated last year
• merrymercy / Awesome-Efficient-LLM
  A curated list for Efficient Large Language Models
  ☆11Updated last year
• tyler-griggs / melange-release
  ☆47Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆89Updated this week
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆60Updated last year
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆141Updated last year
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆109Updated this week
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆20Updated 3 weeks ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• microsoft / tokenweave
  Accepted to MLSys 2026
  ☆70Updated last week
• tridao / flash-attention-wheels
  ☆61Updated 2 years ago
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆80Updated last year
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆24Updated last month
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• mlc-ai / llm-perf-bench
  ☆120Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆93Updated last year
• casper-hansen / AutoAWQ_kernels
  ☆79Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆83Updated 11 months ago