inferx-net / inferxLinks
InferX: Inference as a Service Platform
☆136Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below
Sorting:
- Enhancing LLMs with LoRA☆169Updated last month
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆120Updated 2 weeks ago
- A platform to self-host AI on easy mode☆171Updated this week
- Sparse Inferencing for transformer based LLMs☆201Updated 2 months ago
- ☆168Updated 2 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated 2 weeks ago
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆276Updated 2 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆81Updated this week
- ☆180Updated last month
- The Fastest Way to Fine-Tune LLMs Locally☆322Updated 7 months ago
- A web application that converts speech to speech 100% private☆76Updated 4 months ago
- ☆206Updated last month
- ☆104Updated 2 months ago
- ☆133Updated 5 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆215Updated this week
- ☆135Updated 5 months ago
- ☆83Updated 2 weeks ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆253Updated last week
- Open source LLM UI, compatible with all local LLM providers.☆176Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆97Updated 3 months ago
- A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.☆205Updated 5 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆79Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated last week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆261Updated 7 months ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆27Updated 2 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆51Updated 5 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆67Updated 7 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- ☆226Updated 5 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆79Updated 2 weeks ago