Benchmarking suite for popular AI APIs
☆88Feb 6, 2025Updated last year
Alternatives and similar repositories for ai-benchmarks
Users that are interested in ai-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Website with current metrics on the fastest AI models.☆42Nov 13, 2024Updated last year
- Python client SDK for Ultravox.☆17Dec 10, 2025Updated 10 months ago
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- Self-host LLMs with vLLM and BentoML☆175Jul 14, 2026Updated 2 months ago
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆19May 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python package for extractive NLP using the OpenAI API☆17Aug 28, 2024Updated 2 years ago
- A MCP (Model Context Protocol) server to allow code security reviews using https://osv.dev (Open Source Vulnerabilities Database)☆15Dec 24, 2025Updated 9 months ago
- Accelerating SPARQL Queries by Exploiting Hash-based Locality and Adaptive Partitioning☆10Jan 21, 2016Updated 10 years ago
- A minimal hackable implementation of policy gradient methods (GRPO, PPO, REINFORCE)☆18Feb 20, 2026Updated 7 months ago
- ☆36Jun 4, 2025Updated last year
- Pure Java Llama2 inference with optional multi-GPU CUDA implementation☆15Sep 2, 2023Updated 3 years ago
- ☆28Apr 1, 2026Updated 6 months ago
- ☆473Jan 10, 2024Updated 2 years ago
- ☆16Aug 5, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆14Jul 22, 2025Updated last year
- A Simpler Highcharts wrapper for use in R and R Shiny.☆15Feb 16, 2025Updated last year
- ☆38Jan 22, 2025Updated last year
- This repository contains papers for a comprehensive survey on accelerated generation techniques in Large Language Models (LLMs).☆11May 24, 2024Updated 2 years ago
- The evaluation framework for the InfiCoder-Eval benchmark.☆21Jul 22, 2024Updated 2 years ago
- Datasets for hackernews posts☆16Feb 17, 2022Updated 4 years ago
- Neutron plugins for Ironic/Neutron integration. Mirror of code maintained at opendev.org.☆11Sep 29, 2026Updated last week
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 3 years ago
- LLM Serving Performance Evaluation Harness☆86Feb 25, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- GPT-4 を用いて、言語モデルの応答を自動評価するスクリプト☆17Jun 6, 2024Updated 2 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35May 24, 2024Updated 2 years ago
- A common protocol for AI agent tools☆10Oct 21, 2024Updated last year
- A throughput benchmarking tool for network topologies☆11Nov 22, 2016Updated 9 years ago
- Cluster doctor skills☆14May 23, 2026Updated 4 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Jan 4, 2024Updated 2 years ago
- ☆16Aug 19, 2024Updated 2 years ago
- Resources for the shared task on conversational question answering SCAI-QReCC 2021☆29Jun 18, 2022Updated 4 years ago
- LLMPerf is a library for validating and benchmarking LLMs☆1,124Dec 9, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆16May 20, 2025Updated last year
- SaladCloud Virtual Kubelet provider☆17Dec 8, 2025Updated 10 months ago
- Headless Browser Automation in V☆14Jan 14, 2025Updated last year
- Self-hosted LLM chatbot arena, with yourself as the only judge☆40Feb 6, 2024Updated 2 years ago
- PEP-DNA: a Performance Enhancing Proxy for Deploying Network Architectures☆11Jun 19, 2024Updated 2 years ago
- Code to push data from file into the kafka☆12Mar 27, 2018Updated 8 years ago
- The repository contains code for Adaptive Data Optimization☆37Dec 9, 2024Updated last year