Alternatives and similar repositories for llm-benchmark

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆153Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆93Updated 2 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆181Updated last year
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆79Updated 3 months ago
• chigkim / Ollama-MMLU-Pro
  ☆90Updated 5 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆231Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆65Updated this week
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆106Updated this week
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 8 months ago
• matteoserva / GraphLLM
  ☆203Updated 2 weeks ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆228Updated last week
• rombodawg / Easy_training
  ☆48Updated 3 months ago
• Fus3n / gem-assist
  Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
  ☆110Updated 2 months ago
• ParisNeo / ollama_proxy_server
  A proxy server for multiple ollama instances with Key security
  ☆436Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆181Updated this week
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆378Updated last month
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆180Updated this week
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆116Updated 11 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆300Updated 2 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• TesslateAI / Studio
  ☆97Updated 3 weeks ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆567Updated 3 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆116Updated 6 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 2 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated last year
• antibitcoin / ReflectionAnyLLM
  This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)
  ☆319Updated 8 months ago
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆217Updated last month
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆214Updated last week
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆243Updated 3 months ago