Alternatives and similar repositories for LLM-Inference-Benchmark:

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 8 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated 11 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 6 months ago
• curvedinf / novel-writer
  Automated LLM novelist
  ☆43Updated 11 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆73Updated 3 months ago
• charmandercha / ArchiDoc
  ☆17Updated 3 months ago
• Ejb503 / ai-voice-generation
  Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …
  ☆37Updated 9 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated 9 months ago
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 4 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆37Updated last month
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆32Updated 5 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 10 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 5 months ago
• ThanabordeeN / Screenshot_LLM
  Screenshot LLM is a Python application that leverages the power of AI to analyze screenshots. Built with PyQt6 for a user-friendly interf…
  ☆39Updated 4 months ago
• pnmartinez / simple-computer-use
  Open source implementation for computer use, using light OCR models and LLMs.
  ☆14Updated this week
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆39Updated 6 months ago
• Magnetron85 / PyChat
  Python language chat with Ollama models locally, anthropic and openai
  ☆16Updated this week
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 10 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated last month
• Krisseck / Phrasing-Bot
  A bot that checks your grammar and phrasing using LLM of choice
  ☆29Updated last month
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆32Updated last month
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 9 months ago
• cognitivecomputations / agenticworker
  ☆23Updated 4 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• hyperfocAIs / Attend
  Attend - to what matters.
  ☆14Updated last month
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆41Updated 6 months ago
• agi-dude / chainlit-rag
  ☆28Updated 5 months ago
• severian42 / Mycomind-Daemon-Ollama-Mixture-of-Memory-RAG-Agents
  Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …
  ☆31Updated 8 months ago
• namuan / chat-circuit
  Branch Out Your Conversations
  ☆33Updated 2 months ago