InferX: Inference as a Service Platform
☆213May 20, 2026Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆179Aug 10, 2025Updated 9 months ago
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated last year
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- ☆213Sep 7, 2025Updated 8 months ago
- Large DNNs training framework for consumer GPUs☆78Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Feb 18, 2024Updated 2 years ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Apr 10, 2026Updated last month
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated last year
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆4,107Updated this week
- Vibe Coded Project Management System☆21Apr 19, 2025Updated last year
- ☆49May 20, 2025Updated last year
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆69Updated this week
- ☆97Mar 28, 2026Updated last month
- ☆1,361May 12, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆493May 14, 2026Updated last week
- ☆20Sep 28, 2024Updated last year
- Deploy Apollo HF space locally☆40Dec 16, 2024Updated last year
- Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆2,946Updated this week
- ☆21Dec 9, 2025Updated 5 months ago
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆16Mar 6, 2026Updated 2 months ago
- Self-hosted LLM chatbot arena, with yourself as the only judge☆41Feb 6, 2024Updated 2 years ago
- ☆22Aug 9, 2024Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- llama.cpp fork with additional SOTA quants and improved performance☆2,448Updated this week
- Mistral7B playing DOOM☆29Mar 27, 2024Updated 2 years ago
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated last year
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆175Jul 5, 2025Updated 10 months ago
- A chat UI for Llama.cpp☆16May 13, 2026Updated last week
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆82Aug 16, 2024Updated last year
- Minimal web client for chatting and roleplay with AI characters☆26Aug 21, 2025Updated 9 months ago
- Samples of good AI generated CUDA kernels☆104May 30, 2025Updated 11 months ago
- Quickly and securely turn any Linux box into a build and deployment assistant☆25Oct 3, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Dec 6, 2023Updated 2 years ago
- ☆16May 8, 2025Updated last year
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆98Apr 2, 2026Updated last month
- 🌳 MCTS-inspired parallel beam search for conversation optimization. Explore multiple dialogue strategies simultaneously, stress-test a…☆36Jan 18, 2026Updated 4 months ago
- Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs☆45May 12, 2026Updated last week
- Writing Tools, Apple's AI-inspired app, enchants Windows, enhancing your pen with AI LLMs. One hotkey press, system-wide, fixes grammar, …☆28Jul 26, 2025Updated 9 months ago
- ☆114Jun 19, 2025Updated 11 months ago