☆58Nov 18, 2024Updated last year
Alternatives and similar repositories for llm-bench
Users that are interested in llm-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Control LLM generation format efficiently. A simple version of microsoft/aici in vllm and transformers☆14Jun 7, 2024Updated 2 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆137Feb 22, 2024Updated 2 years ago
- ☆18Aug 19, 2024Updated 2 years ago
- Python bindings for NVIDIA CUDA APIs.☆14Mar 2, 2024Updated 2 years ago
- ☆12Mar 16, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆21Updated this week
- Linux tree for ntrdma driver development.☆11Jun 29, 2017Updated 9 years ago
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated 2 months ago
- PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]☆16Apr 30, 2026Updated 4 months ago
- ☆16May 14, 2025Updated last year
- ☆10Feb 17, 2026Updated 6 months ago
- Python tools☆14Oct 22, 2023Updated 2 years ago
- ☆17Apr 16, 2026Updated 4 months ago
- Reduction Server in Rust☆14Apr 9, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- ☆12Jun 30, 2024Updated 2 years ago
- My solutions to the peer-reviewed assignments in the Data Science Professional Specialization offered by IBM on Coursera.☆14Jan 15, 2024Updated 2 years ago
- Comparison of Language Model Inference Engines☆244Dec 16, 2024Updated last year
- Convert Travis.yml to GitHub Actions workflows.☆12Aug 20, 2022Updated 4 years ago
- ☆14Aug 28, 2019Updated 7 years ago
- git tracking for python notebooks☆12Jun 15, 2017Updated 9 years ago
- Crypto wallet and NFT based Imageboard, built on Django REST API using React, Web3, Docker, Nginx and PostgreSQL.☆20Jan 14, 2022Updated 4 years ago
- A Turkish question answering system made by fine-tuning BERTurk and XLM-Roberta models.☆12Feb 13, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Codewars katas(Python, SQL, C++) and freeCodeCamp projects☆10Dec 27, 2024Updated last year
- A C++ ROS package for real-time conversion of 3D motion controller events to ROS messages.☆12Feb 13, 2024Updated 2 years ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- LLM Serving Performance Evaluation Harness☆85Feb 25, 2025Updated last year
- A sample pattern for running CI tests on Modal☆20Apr 12, 2025Updated last year
- Tools for MPI programmers☆14Sep 21, 2020Updated 5 years ago
- ☆63May 4, 2024Updated 2 years ago
- Lightweight Python library for formatting LLM chat prompts☆14Jan 22, 2024Updated 2 years ago
- ☆15Mar 30, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LLMPerf is a library for validating and benchmarking LLMs☆1,126Dec 9, 2024Updated last year
- ☆17Updated this week
- A C++ project which efficiently solves any given N-puzzle using backtracking on a decision tree.☆11Oct 21, 2023Updated 2 years ago
- SWIG bindings for Kaldi I/O, built with Conda☆15Dec 15, 2024Updated last year
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- Terraform modules for deploying DAOS on GCP☆11Jan 17, 2024Updated 2 years ago
- Pocket Survival Guide for Sys Admin - http://psg.skinforum.org/ -☆15Jul 1, 2026Updated 2 months ago