Alternatives and similar repositories for LLM-Inference-Benchmark

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 7 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• Belluxx / LocalAIME
  Test your local LLMs on the AIME problems
  ☆28Updated 2 weeks ago
• Ejb503 / ai-voice-generation
  Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …
  ☆37Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 6 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 9 months ago
• umar-mq / chainlit-rag
  ☆29Updated 8 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆31Updated this week
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 8 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 9 months ago
• TAR-ALEX / llm-html
  ☆17Updated last month
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆93Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated last year
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆41Updated 4 months ago
• severian42 / Proteus-The-Genesis-LLM
  Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine
  ☆22Updated 6 months ago
• tegridydev / abstract-agent
  Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts
  ☆23Updated last month
• adrienbrault / ollama-nous-hermes2pro
  Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF
  ☆32Updated last year
• patw / Bottybot
  A conversational UI for chatbots using the llama.cpp server
  ☆14Updated last month
• curvedinf / novel-writer
  Automated LLM novelist
  ☆47Updated last year
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 11 months ago
• rodrigobaron / anthill
  ☆24Updated 5 months ago
• qingy1337 / xplore-terminallm
  Allows two LLMs to communicate and run code in the terminal
  ☆25Updated 6 months ago
• eurdoch / toolla
  High level tool use for LLMs
  ☆34Updated 10 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 10 months ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated last year
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆27Updated last month
• rapidarchitect / ollama-crew-mesop
  ☆29Updated 9 months ago