Alternatives and similar repositories for LLM-Inference-Benchmark

Users that are interested in LLM-Inference-Benchmark are comparing it to the libraries listed below

• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆97Updated 4 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated last year
• remichu-ai / gallama
  ☆133Updated 6 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆83Updated 5 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆111Updated last year
• umar-mq / chainlit-rag
  ☆30Updated last year
• dynamiccreator / voice-text-reader
  Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)
  ☆52Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated last year
• QuixiAI / generate
  ☆28Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆100Updated 2 months ago
• curvedinf / novel-writer
  Automated LLM novelist
  ☆44Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• charmandercha / ArchiDoc
  ☆17Updated 10 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆97Updated last year
• intentee / llmops-handbook
  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…
  ☆76Updated last year
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆190Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• nico-martin / jarvis
  your private, personal assistant
  ☆59Updated last month
• philfung / perplexed
  Open-source Perplexity app.
  ☆137Updated 3 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆83Updated last year
• abgulati / kosmos-2_5-containerized
  Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…
  ☆64Updated last year
• synw / agent-smith
  Local first human friendly agents toolkit for the browser and Nodejs
  ☆44Updated last week
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• rombodawg / Easy_training
  ☆51Updated 8 months ago
• mlc-delgado / pytldr-oss
  An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…
  ☆57Updated last year
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆128Updated last year
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆41Updated 9 months ago
• molbal / llm-text-completion-finetune
  Guide on text completion large language model fine-tuning, including example scripts and training data acquiring.
  ☆84Updated 8 months ago