Adaptive batch inference pipeline with semantic complexity routing, circuit breaker fault tolerance, and SSE-streamed progress, built for production-scale ticket processing
☆25May 19, 2026Updated 5 months ago
Alternatives and similar repositories for inference-forge
Users that are interested in inference-forge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Letta Code mod packages and examples☆22Oct 6, 2026Updated 2 weeks ago
- A collection of all the algorithms, analysis and working codes for the CYL47 course programs!☆13Aug 15, 2023Updated 3 years ago
- A Pure JAX AsyncRL stack☆23Sep 7, 2026Updated last month
- niat mcp☆16Jul 18, 2025Updated last year
- ☆12Dec 4, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A small, statically-typed programming language and its compiler, written in Rust☆52Oct 12, 2026Updated last week
- Fast, lightweight toy container system☆12Oct 18, 2020Updated 6 years ago
- Starter and solution code for "Display nearby places in AR on Android in Kotlin" codelab.☆18Jul 7, 2026Updated 3 months ago
- ☆11Jul 16, 2024Updated 2 years ago
- A minimal seed template for an Apache Pekko in Scala☆16Updated this week
- Claude Code skill: turn your last AI coding session into a credibility-checked, quiz-placed reading path☆17Aug 1, 2026Updated 2 months ago
- ☆11Nov 5, 2024Updated last year
- A package for computing differential emission measures using multiple methods with a common API☆13Oct 16, 2026Updated last week
- End-to-end development pipeline for predicting retail gas prices in Seattle using deep learning.☆10Sep 1, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Oct 15, 2026Updated last week
- Implemented LLM from Scratch☆11Jun 4, 2025Updated last year
- A Privacy Layer For Using Frontier LLMs Anonymously☆18Mar 21, 2026Updated 7 months ago
- everything you need to know about inference engineering☆43Sep 29, 2026Updated 3 weeks ago
- ☆14Jan 28, 2026Updated 8 months ago
- Service Discovery for Java☆17Oct 15, 2026Updated last week
- ☆17Aug 22, 2026Updated 2 months ago
- Archive of Google Summer of Code (GSoC) accepted proposals across years for community reference and inspiration.☆284Oct 9, 2026Updated last week
- WallGodds is reimagined for mobile — fast, clean, and loaded with stunning high-res wallpapers for every screen. It’s more than an app — …☆18Mar 15, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆30Aug 4, 2025Updated last year
- Accessible React charts with expressive themes, a live gallery, and documentation.☆24Sep 28, 2026Updated 3 weeks ago
- Continual Learning: A Systematic Literature Review☆21Nov 13, 2025Updated 11 months ago
- RabbitMQ based actor system for dropwizard☆14Oct 15, 2026Updated last week
- Fused KL divergence from hidden states for knowledge distillation☆22Apr 28, 2026Updated 5 months ago
- 👁🗨 Floating hints to highlight product features.☆13Jul 2, 2018Updated 8 years ago
- ☆18Updated this week
- Generates text with diffusion models. Reproduction of the Continous Diffusion for Categorical Data paper by Deepmind☆20Dec 9, 2024Updated last year
- See what's going on inside of WordPress☆13Nov 1, 2016Updated 9 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Bulk mailer implemented in flask framework using SendGrid api for mailing. It has templating, group mailing with a rich text editor.☆25Mar 20, 2023Updated 3 years ago
- ☆14Apr 9, 2025Updated last year
- Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).☆62Sep 26, 2026Updated 3 weeks ago
- Applying SAEs for fine-grained control☆28Dec 15, 2024Updated last year
- The tool to visualise architecture of python packages☆10Aug 16, 2023Updated 3 years ago
- ☆17Feb 21, 2024Updated 2 years ago
- a minimal paged attention implementation☆20Jan 30, 2026Updated 8 months ago