Alternatives and similar repositories for llm-benchmark:

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆203Updated last month
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆346Updated 3 months ago
• Haervwe / open-webui-tools
  a Repository of Open-WebUI tools to use with your favourite LLMs
  ☆182Updated last week
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆373Updated this week
• matteoserva / GraphLLM
  ☆197Updated 2 weeks ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆113Updated 9 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 2 months ago
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆79Updated 3 weeks ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated 11 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆148Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated last week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆73Updated 3 months ago
• mostlygeek / llama-swap
  transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆475Updated this week
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆31Updated 8 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 6 months ago
• severian42 / Cascade-of-Semantically-Integrated-Layers
  CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…
  ☆64Updated 4 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed structured outputs from any language model. Eliminate 100% of schema violations and state tracking failures in your LLM applic…
  ☆120Updated this week
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆285Updated last week
• TheBlewish / Web-LLM-Assistant-Llamacpp-Ollama
  A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp
  ☆346Updated 5 months ago
• chigkim / Ollama-MMLU-Pro
  ☆83Updated 3 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆107Updated 8 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 9 months ago
• KartDriver / mira_converse
  ☆66Updated last month
• crashr / gppm
  GPU Power and Performance Manager
  ☆57Updated 5 months ago
• antibitcoin / ReflectionAnyLLM
  This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)
  ☆318Updated 6 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆116Updated last week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆97Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆243Updated 3 weeks ago
• synth-mania / jarvis
  A command-line personal assistant that integrates with Google Calendar, Gmail, and Tasks to help manage your digital life.
  ☆120Updated 4 months ago
• amanvirparhar / weebo
  A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.
  ☆196Updated 2 months ago