Alternatives and similar repositories for benchllama:

Users that are interested in benchllama are comparing it to the libraries listed below

• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 7 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆44Updated last year
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• pgibler / cmdh
  Create Linux commands from natural language, in the shell.
  ☆109Updated 5 months ago
• marco-souza / omg
  IA-powered Ollama Modelfile Generator
  ☆25Updated 10 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• Shreyas9400 / SearXNG-WebSearch-AI
  AI powered Chatbot with real time updates.
  ☆52Updated 6 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated 11 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated 9 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆38Updated 2 months ago
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆90Updated 3 weeks ago
• remichu-ai / pai
  Your personal and private AI
  ☆45Updated 3 weeks ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 4 months ago
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆31Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆56Updated 2 months ago
• mlc-delgado / pytldr-oss
  An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…
  ☆51Updated 8 months ago
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆73Updated 4 months ago
• taaabs / taaabs
  Public repository with all of our apps.
  ☆74Updated 3 weeks ago
• abrenneke / rivet-plugin-ollama
  Rivet plugin for integration with Ollama, the tool for running LLMs locally easily
  ☆37Updated last year
• j4ys0n / local-ai-stack
  Open WebUI, ComfyUI, n8n, LocalAI, LLM Proxy, SearXNG, Qdrant, Postgres all in docker compose
  ☆51Updated 6 months ago
• taresh18 / conversify-speech
  Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs
  ☆19Updated this week
• Jay4242 / llm-websearch
  My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.
  ☆30Updated last month
• dyad-sh / dyad-mentor
  Delightful AI coding mentor | Open-source, local, hackable | 🌟 Star if it sparks delight!
  ☆45Updated 3 weeks ago
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆35Updated this week
• SingularityMan / vector_stock_market_bot
  A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …
  ☆54Updated 2 months ago
• atgehrhardt / Cerebro-OpenWebUI-Package-Manager
  A third-party package manager for OpenWebUI
  ☆29Updated 9 months ago
• quentin-r37 / sortify-ai
  ☆47Updated 2 months ago
• p-e-w / arrows
  A frontend for creative writing with LLMs
  ☆123Updated 9 months ago