inferx-net / inferxLinks
InferX is a Inference Function as a Service Platform
☆111Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below
Sorting:
- ☆103Updated last month
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆244Updated 2 weeks ago
- Turns devices into a scalable LLM platform☆138Updated this week
- ☆145Updated last month
- ☆130Updated last month
- ☆78Updated this week
- Sparse Inferencing for transformer based LLMs☆183Updated this week
- ☆79Updated 3 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆67Updated this week
- Eternal is an experimental platform for machine learning models and workflows.☆68Updated 3 months ago
- ☆204Updated last month
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆243Updated 4 months ago
- A web application that converts speech to speech 100% private☆71Updated 3 weeks ago
- Orpheus Chat WebUI☆65Updated 2 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆85Updated last week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆76Updated 9 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆136Updated 3 weeks ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated 7 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆31Updated 2 months ago
- ☆204Updated last month
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆158Updated last week
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 9 months ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 9 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆28Updated 5 months ago
- ☆129Updated last month
- Lightweight Inference server for OpenVINO☆187Updated last week
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆219Updated 2 weeks ago
- ☆54Updated this week
- A real-time shared memory layer for multi-agent LLM systems.☆21Updated last week
- ☆96Updated last week