Alternatives and similar repositories for LLM-Inference-Benchmark

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆82Updated 3 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 11 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆95Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 8 months ago
• remichu-ai / gallama
  ☆132Updated 4 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆110Updated last year
• umar-mq / chainlit-rag
  ☆30Updated 11 months ago
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆29Updated 7 months ago
• QuixiAI / kraken
  ☆67Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• curvedinf / novel-writer
  Automated LLM novelist
  ☆47Updated last year
• mlc-delgado / pytldr-oss
  An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…
  ☆55Updated last year
• QuixiAI / generate
  ☆28Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆96Updated 2 weeks ago
• synw / agent-smith
  Local first human friendly agents toolkit for the browser and Nodejs
  ☆44Updated 3 weeks ago
• QuixiAI / dolphin-logger
  ☆102Updated 2 months ago
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated 10 months ago
• nath1295 / LLMFlex
  A python package for developing AI applications with local LLMs.
  ☆152Updated 8 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated last year
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆125Updated 10 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆96Updated 2 months ago
• teknium1 / ShareGPT-Builder
  ☆116Updated 8 months ago
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆185Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated 5 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆99Updated last week
• 0xrushi / Terminal-Voice-Assistant
  Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…
  ☆18Updated last year