Alternatives and similar repositories for LLM-Inference-Benchmark

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 10 months ago
• remichu-ai / gallama
  ☆132Updated 5 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆83Updated 4 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• curvedinf / novel-writer
  Automated LLM novelist
  ☆44Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆111Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 3 months ago
• umar-mq / chainlit-rag
  ☆30Updated last year
• yelboudouri / SwitchAI
  A unified library for interacting with various AI APIs through a standardized interface.
  ☆31Updated 7 months ago
• CalvesGEH / VoiceCraftAPI
  An API for VoiceCraft.
  ☆25Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆117Updated last year
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆46Updated last month
• itsPreto / VECTR8
  Embed anything.
  ☆27Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆52Updated 8 months ago
• rodrigobaron / anthill
  ☆24Updated 8 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆23Updated last year
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆175Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆25Updated 7 months ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆100Updated last month
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated 11 months ago
• QuixiAI / kraken
  ☆67Updated last year
• dynamiccreator / voice-text-reader
  Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)
  ☆52Updated 11 months ago
• synw / agent-smith
  Local first human friendly agents toolkit for the browser and Nodejs
  ☆44Updated 2 weeks ago
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆127Updated 11 months ago
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆33Updated last year
• abgulati / kosmos-2_5-containerized
  Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…
  ☆63Updated last year