InferX: Inference as a Service Platform
☆218Jun 25, 2026Updated this week
Alternatives and similar repositories for inferx
Users that are interested in inferx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆179Aug 10, 2025Updated 10 months ago
- OllaDeck is a purple technology stack for Generative AI (text modality) cybersecurity. It provides a comprehensive set of tools for both …☆17Sep 21, 2024Updated last year
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- ☆13Feb 18, 2024Updated 2 years ago
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated 2 years ago
- Good enough PDF parser for CPU☆15Aug 9, 2024Updated last year
- Vibe Coded Project Management System☆21Apr 19, 2025Updated last year
- ☆50May 20, 2025Updated last year
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆4,814Updated this week
- BitTorrent Data Set☆12Jan 2, 2025Updated last year
- ☆98Mar 28, 2026Updated 3 months ago
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆496Updated this week
- ☆20Sep 28, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆1,420Jun 23, 2026Updated last week
- a Python library that uses Reinforcement Learning (RL) to train LLMs.☆43Jun 24, 2026Updated last week
- Deploy Apollo HF space locally☆40Dec 16, 2024Updated last year
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆84Jun 22, 2026Updated last week
- Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.☆3,112Jun 21, 2026Updated last week
- ☆22Dec 9, 2025Updated 6 months ago
- Self-hosted LLM chatbot arena, with yourself as the only judge☆41Feb 6, 2024Updated 2 years ago
- ☆23Aug 9, 2024Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mistral7B playing DOOM☆29Mar 27, 2024Updated 2 years ago
- llama.cpp fork with additional SOTA quants and improved performance☆2,804Updated this week
- LexiCrawler is a powerful Go-based web crawling API meticulously designed to extract, clean, and transform web page content into a pristi…☆48Feb 27, 2025Updated last year
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆181Jul 5, 2025Updated 11 months ago
- Minimal web client for chatting and roleplay with AI characters☆26Aug 21, 2025Updated 10 months ago
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆83Aug 16, 2024Updated last year
- Samples of good AI generated CUDA kernels☆105May 30, 2025Updated last year
- ☆16May 8, 2025Updated last year
- ☆14Dec 6, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A framework for few-shot evaluation of autoregressive language models.☆13Jul 14, 2025Updated 11 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆100Apr 2, 2026Updated 3 months ago
- 🌳 MCTS-inspired parallel beam search for conversation optimization. Explore multiple dialogue strategies simultaneously, stress-test a…☆36Jan 18, 2026Updated 5 months ago
- Tokenflood is a load testing framework for simulating arbitary loads on instruction-tuned LLMs☆46Updated this week
- Writing Tools, Apple's AI-inspired app, enchants Windows, enhancing your pen with AI LLMs. One hotkey press, system-wide, fixes grammar, …☆28Jun 23, 2026Updated last week
- ☆113Jun 19, 2025Updated last year
- Using deep research workflow to generate datasets for finetuning LLMs.☆40Oct 9, 2025Updated 8 months ago