Alternatives and similar repositories for LLM-Inference-Benchmark

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• charmandercha / ArchiDoc
  ☆17Updated 5 months ago
• Ejb503 / ai-voice-generation
  Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …
  ☆37Updated 11 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 6 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆40Updated 4 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 9 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 5 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆110Updated 11 months ago
• cognitivecomputations / dolphin-logger
  ☆75Updated 2 weeks ago
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated 11 months ago
• qingy1337 / xplore-terminallm
  Allows two LLMs to communicate and run code in the terminal
  ☆24Updated 5 months ago
• rodrigobaron / anthill
  ☆24Updated 4 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆49Updated 8 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated last year
• umar-mq / chainlit-rag
  ☆28Updated 8 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆48Updated 3 months ago
• mshumer / portal
  ☆28Updated 6 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated 11 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆25Updated 2 months ago
• AiFlowSolutions / MADS
  A framework that uses multi-agents to enable users to perform a systematic data science pipeline with just two inputs.
  ☆42Updated 9 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated last year
• CalvesGEH / VoiceCraftAPI
  An API for VoiceCraft.
  ☆25Updated 11 months ago
• severian42 / Proteus-The-Genesis-LLM
  Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine
  ☆22Updated 5 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 11 months ago