Alternatives and similar repositories for llama-throughput-lab

Users that are interested in llama-throughput-lab are comparing it to the libraries listed below

• loglux / FlexAudioPrint

  View on GitHub
  FlexAudioPrint is a Python-based app for transcribing audio to text using OpenAI's Whisper model. It offers a Gradio web interface and a …
  ☆10Jan 29, 2026Updated 2 weeks ago
• stimm-ai / stimm

  View on GitHub
  The Open Source Voice Agent Platform. Orchestrate ultra-low latency AI pipelines for real-time conversations over WebRTC.
  ☆39Dec 21, 2025Updated last month
• shabbirun / n8nclaw

  View on GitHub
  A lite version of OpenClaw built on n8n
  ☆75Updated this week
• R-Dson / llamate

  View on GitHub
  A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.
  ☆23Jan 2, 2026Updated last month
• rochus-keller / Interlisp

  View on GitHub
  Tools to analyze Interlisp source code, to support VM development, and to eventually bootstrap systems
  ☆16Jan 12, 2025Updated last year
• Viceman256 / TensorTune

  View on GitHub
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆30May 18, 2025Updated 8 months ago
• vintrocode / curation-buddy

  View on GitHub
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆21May 2, 2024Updated last year
• AutonomicPerfectionist / PipeInfer

  View on GitHub
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆32Nov 16, 2024Updated last year
• Jay4242 / llm-websearch

  View on GitHub
  My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.
  ☆39Jan 27, 2026Updated 2 weeks ago
• smartaces / dia_podcast_generator

  View on GitHub
  ☆54May 28, 2025Updated 8 months ago
• yazon / flexllama

  View on GitHub
  🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…
  ☆50Nov 26, 2025Updated 2 months ago
• AlgorithmicKing737 / orpheus-tts-local-openai

  View on GitHub
  Run Orpheus 3B Locally With LM Studio
  ☆32Mar 20, 2025Updated 10 months ago
• FlipByBlink / PersonasFlip

  View on GitHub
  Flip Board Game for Spatial SharePlay 【Apple Vision Pro】
  ☆14Jan 3, 2026Updated last month
• xinghaow99 / BitStack

  View on GitHub
  [ICLR 2025] BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments
  ☆39Feb 17, 2025Updated 11 months ago
• JoeCastrom / mcp-chat-studio

  View on GitHub
  A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…
  ☆18Jan 7, 2026Updated last month
• DonutsDelivery / ComfyUI-DonutNodes

  View on GitHub
  ☆17Feb 4, 2026Updated last week
• adelva1984 / megazeux

  View on GitHub
  Legacy official MegaZeux git repository. Use http://github.com/AliceLR/megazeux instead.
  ☆14Jul 19, 2018Updated 7 years ago
• calapsss / assistants-api-easy

  View on GitHub
  Easy Implementation of Assistants API with Code Interpreter and File Retrieval
  ☆43Dec 9, 2023Updated 2 years ago
• KartDriver / mira_converse

  View on GitHub
  ☆83Feb 28, 2025Updated 11 months ago
• stanford-oval / chainlite

  View on GitHub
  LangChain + LiteLLM that works
  ☆50Sep 1, 2025Updated 5 months ago
• ottowg / gsap-ner

  View on GitHub
  ☆10Oct 2, 2024Updated last year
• serhei / course-scheduler

  View on GitHub
  Linear programming model for class schedule generation
  ☆11Oct 11, 2015Updated 10 years ago
• prismicio / vuejs-blog

  View on GitHub
  ☆11Jan 7, 2023Updated 3 years ago
• stockeh / mlx-trm

  View on GitHub
  MLX Implementation of Recursive Reasoning with Tiny Networks
  ☆78Oct 11, 2025Updated 4 months ago
• tecno-consultores / llm-lab

  View on GitHub
  Docker Compose to install N8N, Openweb UI, Qdrant, Ollama, EvolutionAPI and other systems.
  ☆10Feb 7, 2026Updated last week
• No-Raccoon1456 / NR-PROMPT-ENGINEERING

  View on GitHub
  ☆10Sep 29, 2024Updated last year
• baselm / capstoneproject

  View on GitHub
  ☆11May 8, 2022Updated 3 years ago
• revisionhiep-create / LocalReader-Pro

  View on GitHub
  Standalone desktop application for Text-to-Speech (TTS) utilizing the Kokoro-82M AI model for pdf files
  ☆28Updated this week
• MateoRbt / HomeServer

  View on GitHub
  Home server set up
  ☆13Oct 5, 2025Updated 4 months ago
• hammsvietro / blazer

  View on GitHub
  Blazer is a case parser for maps and JSON keys using NIFs.
  ☆11Jun 8, 2022Updated 3 years ago
• smpanaro / apple-silicon-4bit-quant

  View on GitHub
  Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"
  ☆11Mar 31, 2024Updated last year
• fm4dd / suntracker2-r3

  View on GitHub
  Single-axis solar position tracking prototype with a Cortex M0 MCU (Ardunio MKRZero)
  ☆13Apr 13, 2020Updated 5 years ago
• Hirnschall-Technologies / 4x-sata-backplane

  View on GitHub
  custom backplane for diy nas (4xSATA)
  ☆16May 12, 2024Updated last year
• mariniss / mylibrary-contracts

  View on GitHub
  Simple Akka HTTP project implemented to describe how to build Microservices with Consumer Driven Contracts testing approach
  ☆11Feb 15, 2018Updated 8 years ago
• everruns / bashkit

  View on GitHub
  Virtual Bash interpreter with a virtual file system for multi-tenant environments.
  ☆31Updated this week
• bkpaine1 / AMD-Strix-Halo-AI-Guide

  View on GitHub
  Technical docs to help you make you Halo Strix WORK!
  ☆23Jan 10, 2026Updated last month
• mrchrisok / OandaV20.3

  View on GitHub
  .NET library that provides Forex trading integration with the Oanda V20 REST Api.
  ☆11Nov 20, 2024Updated last year
• ANSSI-FR / ProTIP

  View on GitHub
  ProTIP permet de caractériser la connectivité réelle entre composants d'une architecture PCI Express
  ☆10Nov 9, 2023Updated 2 years ago
• xoniks / mcp-visualization-duckdb

  View on GitHub
  Transform natural language into beautiful, interactive data visualizations using the Model Context Protocol (MCP) with Claude Desktop int…
  ☆15Jun 27, 2025Updated 7 months ago