Alternatives and similar repositories for llm-benchmark

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆255Updated 2 weeks ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆156Updated last year
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆461Updated last week
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆385Updated 2 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆146Updated 2 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆79Updated 4 months ago
• matteoserva / GraphLLM
  ☆204Updated last month
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆116Updated 2 weeks ago
• Haervwe / open-webui-tools
  a Repository of Open-WebUI tools to use with your favourite LLMs
  ☆247Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆257Updated 4 months ago
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆319Updated 4 months ago
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆185Updated 11 months ago
• TheBlewish / Web-LLM-Assistant-Llamacpp-Ollama
  A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp
  ☆357Updated 8 months ago
• AaronFeng753 / Ollama-Model-Dumper
  Export and Backup Ollama models into GGUF and ModelFile
  ☆75Updated 10 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• nath1295 / LLMFlex
  A python package for developing AI applications with local LLMs.
  ☆150Updated 6 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆290Updated 8 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆256Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆312Updated 3 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆110Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆578Updated 5 months ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆257Updated 3 weeks ago
• kevkid / gguf_gui
  ☆116Updated 8 months ago
• distantmagic / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆69Updated 11 months ago
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆92Updated last year
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆333Updated 3 weeks ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆98Updated this week
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆602Updated 8 months ago