Inference server benchmarking tool
☆171Jun 9, 2026Updated 2 months ago
Alternatives and similar repositories for inference-benchmarker
Users that are interested in inference-benchmarker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal implementation of a Byte Pair Encoding (BPE) tokenizer in Zig☆15Apr 7, 2025Updated last year
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- Build compute kernels and load them from the Hub.☆739Updated this week
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆97Updated this week
- Where GPUs get cooked 👩🍳🔥☆406May 26, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A course on building Large Language Models☆20Mar 24, 2025Updated last year
- 👷 Build compute kernels☆213Apr 6, 2026Updated 4 months ago
- Benchmark suite for LLMs from Fireworks.ai☆114Updated this week
- Simple examples using Argilla tools to build AI☆59Nov 18, 2024Updated last year
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solu…☆634Updated this week
- Code and Data for Evaluating the Evaluators☆16Aug 20, 2025Updated last year
- ☆23May 26, 2026Updated 3 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆720Aug 20, 2026Updated 2 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆17Aug 14, 2026Updated 3 weeks ago
- TUI for LM Studio☆17Oct 19, 2025Updated 10 months ago
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆30Dec 17, 2024Updated last year
- Implementation of the HuggingFace Xet Protocol.☆28Aug 13, 2026Updated 3 weeks ago
- ☆29May 26, 2026Updated 3 months ago
- Hugging Face Jobs☆20Jul 11, 2025Updated last year
- Use safetensors with ONNX 🤗☆90Aug 4, 2026Updated last month
- ☆25Oct 10, 2025Updated 10 months ago
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆25Dec 13, 2024Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆291Jul 11, 2024Updated 2 years ago
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,583Updated this week
- Decodes Compact Disc data from microscope images of a CD's surface☆12Jan 14, 2023Updated 3 years ago
- Patch management tool for git submodules☆18Jul 25, 2025Updated last year
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆341May 26, 2026Updated 3 months ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- Synthetic Data Generation with Execution-Based Verification and Grounding for LLM Training.☆23Feb 7, 2025Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,534Aug 11, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20Oct 5, 2025Updated 11 months ago
- ☆33Apr 19, 2025Updated last year
- An experimental autonomous research system that conducts comprehensive, multi-hour research sessions and produces book-length reports wit…☆50Dec 7, 2025Updated 8 months ago
- Clue inspired puzzles for testing LLM deduction abilities☆47Mar 19, 2026Updated 5 months ago
- ☆160Aug 17, 2026Updated 2 weeks ago
- AEGIS-256☆11Apr 10, 2026Updated 4 months ago
- Implementation of Tree esoteric programming language☆10Mar 3, 2023Updated 3 years ago