Nero10578 / LLM-Inference-Benchmark

Related projects ⓘ

Alternatives and complementary repositories for LLM-Inference-Benchmark

• agi-dude / chainlit-rag
  ☆25Updated last month
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated this week
• mlc-delgado / pytldr-oss
  An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…
  ☆43Updated 3 months ago
• ThanabordeeN / Screenshot_LLM
  Screenshot LLM is a Python application that leverages the power of AI to analyze screenshots. Built with PyQt6 for a user-friendly interf…
  ☆29Updated 2 weeks ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆62Updated last month
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆48Updated 6 months ago
• mostlygeek / llama-swap
  HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)
  ☆41Updated this week
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated 7 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆35Updated 3 weeks ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆92Updated 4 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆49Updated this week
• cognitivecomputations / agenticworker
  ☆23Updated this week
• cognitivecomputations / kraken
  ☆64Updated 5 months ago
• Krisseck / Phrasing-Bot
  A bot that checks your grammar and phrasing using LLM of choice
  ☆27Updated 5 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆21Updated 4 months ago
• dynamiccreator / voice-text-reader
  Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)
  ☆47Updated last month
• cognitivecomputations / generate
  ☆28Updated 8 months ago
• remichu-ai / gallama
  ☆112Updated this week
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆87Updated 4 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆28Updated 2 weeks ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated 10 months ago
• SingularityMan / vector_stock_market_bot
  A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …
  ☆35Updated 3 weeks ago
• teknium1 / ShareGPT-Builder
  ☆104Updated 8 months ago
• MichaelMcCulloch / WikiDex
  ☆30Updated 6 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆68Updated 2 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 3 months ago
• cocktailpeanut / hallucinator
  ☆32Updated 2 weeks ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆57Updated 4 months ago
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆25Updated this week
• perk11 / large-model-proxy
  Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…
  ☆47Updated last month