InferX: Inference as a Service Platform
☆201Apr 29, 2026Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆179Aug 10, 2025Updated 8 months ago
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated last year
- Generate audio datasets for training Text-To-Speech models, through smart audio splitting with silence detection, and transcription using…☆30May 27, 2023Updated 2 years ago
- ☆13Feb 18, 2024Updated 2 years ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Apr 10, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆3,641Updated this week
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated last year
- ☆49May 20, 2025Updated 11 months ago
- ☆94Mar 28, 2026Updated last month
- ☆1,347Updated this week
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆489Updated this week
- ☆20Sep 28, 2024Updated last year
- Deploy Apollo HF space locally☆40Dec 16, 2024Updated last year
- One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆2,884Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆21Dec 9, 2025Updated 4 months ago
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆16Mar 6, 2026Updated last month
- Self-hosted LLM chatbot arena, with yourself as the only judge☆41Feb 6, 2024Updated 2 years ago
- llama.cpp fork with additional SOTA quants and improved performance☆2,194Apr 24, 2026Updated last week
- ☆22Aug 9, 2024Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- Mistral7B playing DOOM☆29Mar 27, 2024Updated 2 years ago
- Node.js implementation of Interactive Feedback MCP with modern web-based UI☆27Aug 22, 2025Updated 8 months ago
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆169Jul 5, 2025Updated 9 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆81Aug 16, 2024Updated last year
- A chat UI for Llama.cpp☆16Apr 20, 2026Updated last week
- Minimal web client for chatting and roleplay with AI characters☆26Aug 21, 2025Updated 8 months ago
- Samples of good AI generated CUDA kernels☆103May 30, 2025Updated 11 months ago
- ☆14Dec 6, 2023Updated 2 years ago
- ☆16May 8, 2025Updated 11 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆95Apr 2, 2026Updated 3 weeks ago
- EpochFS is a versioned cloud file system with git-like branching, transaction support.☆17Apr 23, 2026Updated last week
- 🌳 MCTS-inspired parallel beam search for conversation optimization. Explore multiple dialogue strategies simultaneously, stress-test a…☆36Jan 18, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs☆45Apr 24, 2026Updated last week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆118Updated this week
- ☆114Jun 19, 2025Updated 10 months ago
- Give your local LLM a real memory with a lightweight, fully local memory system. 100% offline and under your control.☆72Sep 16, 2025Updated 7 months ago
- DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference☆623Nov 24, 2025Updated 5 months ago
- 🔍📃 LLM-powered PDF Table Extractor☆19Jun 26, 2025Updated 10 months ago
- Neural Audio Codecs implemented in C# - DAC, SNAC, Encodec, Dia☆46Jun 11, 2025Updated 10 months ago