☆58Nov 18, 2024Updated last year
Alternatives and similar repositories for llm-bench
Users that are interested in llm-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Self-host LLMs with vLLM and BentoML☆175Oct 13, 2026Updated 3 weeks ago
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- ☆22Oct 1, 2024Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆17Sep 18, 2026Updated last month
- Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs☆22Oct 22, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆140Feb 22, 2024Updated 2 years ago
- LLMPerf is a library for validating and benchmarking LLMs☆1,127Dec 9, 2024Updated last year
- ☆18Aug 19, 2024Updated 2 years ago
- Tool for the Automatic Assessment of Lexical Diversity☆14Dec 1, 2020Updated 5 years ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆126Mar 13, 2024Updated 2 years ago
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated 4 months ago
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Python bindings for NVIDIA CUDA APIs.☆14Mar 2, 2024Updated 2 years ago
- LLM Inference benchmark☆440Jul 23, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆14Aug 28, 2019Updated 7 years ago
- ☆17Apr 16, 2026Updated 6 months ago
- All notebook for FastAI learning purposes.☆13Jun 11, 2019Updated 7 years ago
- Reduction Server in Rust☆14Apr 9, 2024Updated 2 years ago
- Terraform modules for deploying DAOS on GCP☆11Jan 17, 2024Updated 2 years ago
- Linux tree for ntrdma driver development.☆11Jun 29, 2017Updated 9 years ago
- Intel® MPI Library☆11Sep 22, 2025Updated last year
- Convert Travis.yml to GitHub Actions workflows.☆12Aug 20, 2022Updated 4 years ago
- Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.☆13Jun 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An recognition oriented deep learning framework for biometric sample quality assessment☆12Aug 24, 2023Updated 3 years ago
- ☆14Sep 28, 2020Updated 6 years ago
- Comparison of Language Model Inference Engines☆245Dec 16, 2024Updated last year
- C client for OpenStack Swift object storage service☆10Dec 23, 2013Updated 12 years ago
- Unofficial MSI Afterburner plugin that reads WireView Pro II sensors over USB and shows them in the RTSS on-screen display.☆16Oct 31, 2026Updated last week
- Fixing weird quirks and poor defaults☆16Aug 14, 2026Updated 2 months ago
- ☆15Feb 12, 2026Updated 8 months ago
- A cross-platform and editor-agnostic live previewer for Markdown files☆11Jul 15, 2024Updated 2 years ago
- Disaggregated serving system for Large Language Models (LLMs).☆847Apr 6, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tools for MPI programmers☆14Sep 21, 2020Updated 6 years ago
- Pocket Survival Guide for Sys Admin - http://psg.skinforum.org/ -☆15Sep 12, 2026Updated last month
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- LLM Serving Performance Evaluation Harness☆87Feb 25, 2025Updated last year
- Engine-Agnostic Model Hot-Swapping for Cost-Effective LLM Inference☆15Nov 13, 2025Updated 11 months ago
- Module, Model, and Tensor Serialization/Deserialization☆328Jul 7, 2026Updated 4 months ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year