Alternatives and similar repositories for llm-benchmark:

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆150Updated 11 months ago
• matteoserva / GraphLLM
  ☆198Updated last week
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆210Updated 2 months ago
• chigkim / Ollama-MMLU-Pro
  ☆84Updated 4 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 11 months ago
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆80Updated last month
• Haervwe / open-webui-tools
  a Repository of Open-WebUI tools to use with your favourite LLMs
  ☆199Updated last month
• kevkid / gguf_gui
  ☆108Updated 5 months ago
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆354Updated 3 weeks ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆105Updated last month
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆552Updated 2 months ago
• atineiatte / deep-research-at-home
  ☆169Updated this week
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆90Updated 2 weeks ago
• Gimer-Studios / APIMyLlama
  API up your Ollama Server.
  ☆147Updated 3 weeks ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
  ☆235Updated this week
• dannysemi / runpod-serverless-proxy
  ☆29Updated last year
• synth-mania / jarvis
  A command-line personal assistant that integrates with Google Calendar, Gmail, and Tasks to help manage your digital life.
  ☆121Updated 5 months ago
• intelligencedev / manifold
  Manifold is a platform for enabling workflow automation using AI assistants.
  ☆365Updated last week
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆270Updated 5 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 2 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆214Updated 4 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆149Updated this week
• matatonic / openedai-whisper
  An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.
  ☆74Updated 2 months ago
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆310Updated last month
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆251Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆168Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆305Updated this week
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆293Updated last month
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆580Updated 5 months ago
• 0ssamaak0 / SiriLLama
  Use locally running LLMs directly from Siri 🦙🟣
  ☆169Updated 6 months ago