Alternatives and similar repositories for llm-benchmark

Users that are interested in llm-benchmark are comparing it to the libraries listed below

• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆220Updated 2 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆152Updated 11 months ago
• chigkim / Ollama-MMLU-Pro
  ☆89Updated 4 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆276Updated 6 months ago
• Haervwe / open-webui-tools
  a Repository of Open-WebUI tools to use with your favourite LLMs
  ☆219Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆166Updated this week
• Fus3n / gem-assist
  Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
  ☆106Updated last month
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆79Updated 2 months ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆77Updated this week
• apeatling / simple-guide-to-mlx-finetuning
  Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.
  ☆94Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆80Updated 5 months ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆91Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆61Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆115Updated 10 months ago
• matteoserva / GraphLLM
  ☆202Updated 3 weeks ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• TesslateAI / Studio
  ☆74Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆243Updated 2 months ago
• latent-variable / o1_at_home
  open-webui pipe the aims to replicate the o1 experience
  ☆25Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆109Updated last week
• neuml / rag
  🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.
  ☆362Updated last week
• TesslateAI / TFrameX
  ☆94Updated this week
• distantmagic / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆65Updated 9 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆91Updated 9 months ago
• AaronFeng753 / Ollama-Model-Dumper
  Export and Backup Ollama models into GGUF and ModelFile
  ☆70Updated 8 months ago
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• cognitivecomputations / dolphin-logger
  ☆72Updated last week
• antibitcoin / ReflectionAnyLLM
  This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)
  ☆318Updated 7 months ago