☆58Nov 18, 2024Updated last year
Alternatives and similar repositories for llm-bench
Users that are interested in llm-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Control LLM generation format efficiently. A simple version of microsoft/aici in vllm and transformers☆14Jun 7, 2024Updated 2 years ago
- kernel development code for my work (ioatdma, ntb_hw_intel, idxd, PCI, and CXL related bits)☆12Jun 23, 2026Updated last month
- Self-host LLMs with vLLM and BentoML☆171Jul 14, 2026Updated last month
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆136Feb 22, 2024Updated 2 years ago
- greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)☆13May 7, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python bindings for NVIDIA CUDA APIs.☆14Mar 2, 2024Updated 2 years ago
- ☆21Updated this week
- Linux tree for ntrdma driver development.☆11Jun 29, 2017Updated 9 years ago
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated last month
- PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]☆16Apr 30, 2026Updated 3 months ago
- ☆10Sep 25, 2024Updated last year
- ☆16May 14, 2025Updated last year
- ☆17Apr 16, 2026Updated 4 months ago
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Reduction Server in Rust☆14Apr 9, 2024Updated 2 years ago
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- Comparison of Language Model Inference Engines☆240Dec 16, 2024Updated last year
- Convert Travis.yml to GitHub Actions workflows.☆12Aug 20, 2022Updated 3 years ago
- git tracking for python notebooks☆12Jun 15, 2017Updated 9 years ago
- LLM Serving Performance Evaluation Harness☆84Feb 25, 2025Updated last year
- A sample pattern for running CI tests on Modal☆19Apr 12, 2025Updated last year
- Tools for MPI programmers☆14Sep 21, 2020Updated 5 years ago
- Unit tests for the kernel virtual machine (KVM)☆14Jan 20, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆63May 4, 2024Updated 2 years ago
- ☆15Mar 30, 2026Updated 4 months ago
- LLMPerf is a library for validating and benchmarking LLMs☆1,129Dec 9, 2024Updated last year
- ☆17Jul 27, 2026Updated 3 weeks ago
- An recognition oriented deep learning framework for biometric sample quality assessment☆12Aug 24, 2023Updated 2 years ago
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- ☆15Nov 30, 2020Updated 5 years ago
- This repository will collect and share awesome ChatGPT related papers and useful tools☆17Apr 2, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Explore Inter-layer Expert Affinity in MoE Model Inference☆16May 6, 2024Updated 2 years ago
- Starlight: A Kernel Optimizer for GPU Processing☆16Jan 10, 2024Updated 2 years ago
- ☆11May 17, 2023Updated 3 years ago
- ITIX's Custom CoreOS build☆10Nov 24, 2020Updated 5 years ago
- CLI tool for managing Model Context Protocol (MCP) servers in one place & using them across them different clients☆25Apr 23, 2025Updated last year
- qup: a Single-Node Job Scheduler with NVIDIA GPU support☆18Jan 10, 2023Updated 3 years ago
- Tools to make git easier to use and to avoid the learning curve☆21Apr 3, 2019Updated 7 years ago