Interactive launcher and benchmarking harness for llama.cpp server throughput, with tests, sweeps, and round‑robin load tools.
☆469Feb 8, 2026Updated 7 months ago
Alternatives and similar repositories for llama-throughput-lab
Users that are interested in llama-throughput-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆328Apr 13, 2026Updated 5 months ago
- ☆236Feb 1, 2026Updated 8 months ago
- A long-context code retrieval and reproduction benchmark.☆306Sep 4, 2026Updated last month
- llama-benchy - llama-bench style benchmarking tool for all backends☆744Jul 10, 2026Updated 2 months ago
- ☆1,974Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,828Updated this week
- Model Shelf is a local-first model resolver that helps AI agents and scripts find model weights on your own storage before downloading fr…☆130Sep 1, 2026Updated last month
- ☆533Updated this week
- ☆42Sep 22, 2025Updated last year
- This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.☆20Apr 8, 2026Updated 5 months ago
- Universal text classifier for generative models☆25Jul 25, 2024Updated 2 years ago
- ☆20Jul 21, 2026Updated 2 months ago
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆5,820Updated this week
- Docker configuration for running VLLM on dual DGX Sparks☆2,347Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM inference in C/C++☆130,285Updated this week
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆61Sep 26, 2026Updated last week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆22Jul 14, 2025Updated last year
- Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…☆21May 2, 2024Updated 2 years ago
- A comprehensive WebUI Toolkit for Resemble-AI's Chatterbox☆29Jun 7, 2025Updated last year
- container-transform in go☆12Dec 12, 2017Updated 8 years ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- llama.cpp fork with additional SOTA quants and improved performance☆3,274Updated this week
- [ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Apr 6, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Run frontier AI locally.☆47,741Updated this week
- LLM inference in C/C++☆64May 7, 2026Updated 4 months ago
- ☆176Apr 7, 2026Updated 5 months ago
- Run Claude Code (and codex) to generate a project plan, then run them in a loop for days until they're done☆14Jan 18, 2026Updated 8 months ago
- Talking notification system for Claude Code☆15Feb 16, 2026Updated 7 months ago
- [ICML 2026] Improving GPT via a simple normalization strategy☆15May 22, 2026Updated 4 months ago
- Contains Colab Notebooks show cool use-cases of different GCP ML APIs.☆10Nov 5, 2020Updated 5 years ago
- ☆256Oct 30, 2025Updated 11 months ago
- Diffusion_TTS extension for booga☆71Sep 6, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆15Jan 13, 2024Updated 2 years ago
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Jun 16, 2026Updated 3 months ago
- Resources related to EMNLP 2021 paper "FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations"☆13Dec 14, 2021Updated 4 years ago
- ☆20Jan 3, 2026Updated 9 months ago
- Agent Zero AI framework☆19,369Updated this week
- Tutorial Assets☆615Dec 15, 2025Updated 9 months ago
- a browser gui for nvidia smi☆21Mar 17, 2025Updated last year