Alternatives and similar repositories for inferx:

Users that are interested in inferx are comparing it to the libraries listed below

• theroyallab / YALS
  ☆66Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆58Updated last week
• p-e-w / arrows
  A frontend for creative writing with LLMs
  ☆123Updated 9 months ago
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 2 months ago
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆53Updated last month
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 7 months ago
• kalavai-net / kalavai-client
  Turns devices into a scalable LLM platform
  ☆130Updated this week
• chigkim / Ollama-MMLU-Pro
  ☆89Updated 4 months ago
• matteoserva / GraphLLM
  ☆201Updated 2 weeks ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆116Updated 4 months ago
• remichu-ai / gallama
  ☆130Updated last week
• severian42 / Cascade-of-Semantically-Integrated-Layers
  CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…
  ☆65Updated 6 months ago
• KartDriver / mira_converse
  ☆75Updated 2 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆109Updated 10 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆163Updated last week
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 7 months ago
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆209Updated 3 weeks ago
• atineiatte / deep-research-at-home
  ☆184Updated last week
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆120Updated 6 months ago
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆240Updated 3 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• jaco-bro / diajax
  Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.
  ☆25Updated this week
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆128Updated last week
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆67Updated 6 months ago
• tarun7r / Vocal-Agent
  A cutting-edge Cascading voice assistant combining real-time speech recognition, AI reasoning, and neural text-to-speech capabilities.
  ☆85Updated this week
• Modern-Prometheus-AI / AdaptiveModularNetwork
  Adaptive Modular Network (AMN) a potentially novel machine learning architecture capable of producing models which can learn at inference…
  ☆52Updated 2 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• jake83741 / vnc-lm
  A Discord bot for large language models. Add Gemini 2.5 Pro, Claude Sonnet 3.7, GPT 4.1, and other models. Easily change models, edit pro…
  ☆82Updated 2 weeks ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆53Updated 6 months ago
• Lex-au / Vocalis
  Speech-to-speech AI assistant with natural conversation flow, mid-speech interruption, vision capabilities and AI-initiated follow-ups. F…
  ☆132Updated 3 weeks ago