inferx-net / inferxLinks
InferX is a Inference Function as a Service Platform
☆105Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below
Sorting:
- ☆97Updated 3 weeks ago
- ☆71Updated last week
- ☆120Updated last week
- ☆197Updated 3 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆62Updated this week
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆228Updated last week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆72Updated 8 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated 6 months ago
- ☆202Updated 2 weeks ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated 8 months ago
- Turns devices into a scalable LLM platform☆134Updated last week
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆133Updated last month
- ☆28Updated last month
- ☆76Updated 3 months ago
- ☆129Updated last month
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆242Updated 3 months ago
- Orpheus Chat WebUI☆62Updated 2 months ago
- A lightweight recreation of OS1/Samantha from the movie Her, running locally in the browser☆97Updated last month
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆217Updated last month
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆30Updated last month
- A Discord bot for large language models. Add Gemini 2.5 Pro, Claude Sonnet 3.7, GPT 4.1, and other models. Easily change models, edit pro…☆82Updated last month
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆51Updated this week
- Streaming for Chatterbox TTS☆48Updated this week
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆30Updated 2 months ago
- Adaptive Modular Network (AMN) a potentially novel machine learning architecture capable of producing models which can learn at inference…☆52Updated 2 months ago
- AI management tool☆116Updated 6 months ago
- A web application that converts speech to speech 100% private☆58Updated this week
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆52Updated 7 months ago
- LLM Inference on consumer devices☆115Updated 2 months ago
- Lightweight Inference server for OpenVINO☆176Updated last week