inferx-net / inferxLinks
InferX: Inference as a Service Platform
☆136Updated last week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below
Sorting:
- Enhancing LLMs with LoRA☆140Updated 3 weeks ago
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆110Updated 3 months ago
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆279Updated last month
- ☆209Updated 3 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆82Updated this week
- Sparse Inferencing for transformer based LLMs☆201Updated last month
- Lightweight Inference server for OpenVINO☆212Updated last week
- A platform to self-host AI on easy mode☆171Updated this week
- ☆178Updated 3 weeks ago
- ☆165Updated last month
- A web application that converts speech to speech 100% private☆76Updated 4 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆146Updated last week
- ☆134Updated 5 months ago
- ☆101Updated last month
- The Fastest Way to Fine-Tune LLMs Locally☆321Updated 6 months ago
- ☆133Updated 5 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated last year
- ☆85Updated this week
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆28Updated 2 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- Easily view and modify JSON datasets for large language models☆83Updated 4 months ago
- Open source LLM UI, compatible with all local LLM providers.☆175Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆259Updated 7 months ago
- ☆83Updated 7 months ago
- ☆224Updated 4 months ago
- A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.☆202Updated 4 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆255Updated 7 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated 3 weeks ago
- Code execution utilities for Open WebUI & Ollama☆297Updated 10 months ago