A distributed inference framework for large language models that routes requests to workers, manages KV cache lifecycle, handles failures gracefully, and applies backpressure so memory — not compute — is the bottleneck.
☆27Oct 6, 2026Updated last month
Alternatives and similar repositories for distributed-inference-engine
Users that are interested in distributed-inference-engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A research project to use WebAuthn with Account Abstraction (ERC 4337)☆10Jul 16, 2024Updated 2 years ago
- Dex for Perpetual futures with multiple liquidity mechanisms☆21Aug 19, 2025Updated last year
- [Hackathon winner]A production-ready micropayment gateway that implements HTTP 402 (Payment Required) to monetize access to historical So…☆22Dec 3, 2025Updated 11 months ago
- Turn your agent into a mentor. It knows what you're working toward, and how you get in your own way.☆17Aug 7, 2026Updated 3 months ago
- AI Proctoring System☆10May 27, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jul 7, 2026Updated 4 months ago
- App for demonstrating the zkLogin capabilities☆10Nov 21, 2023Updated 2 years ago
- A VPN written in Rust☆14Apr 17, 2025Updated last year
- curated list of proof of personhood approaches and papers.☆18Aug 13, 2025Updated last year
- oxydra - An agent with many heads, zero overhead☆57Apr 5, 2026Updated 7 months ago
- ☆13Jul 7, 2025Updated last year
- ☆14Aug 25, 2026Updated 2 months ago
- Source code for the learning pi through force blog☆12Jul 13, 2026Updated 3 months ago
- Agent Harness prototype with main components and deployment on Railway☆27Aug 21, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆12Feb 11, 2026Updated 9 months ago
- ☆46Oct 21, 2026Updated 3 weeks ago
- A production-ready, multi-channel AI agent for AIOps, Kubernetes management, and automated remediation — built on FastAPI with support fo…☆16Oct 3, 2026Updated last month
- Just a simple website made with NextJS and CSS that shows realtime news.☆10Feb 17, 2022Updated 4 years ago
- ☆17Aug 2, 2026Updated 3 months ago
- add the charles ssl certificate to an android .apk file. Use that modified .apk to collect HTTP traffic.☆10Mar 21, 2023Updated 3 years ago
- Learn to build AI agents with the open-source Strands SDK, then deploy and operate them in production with Amazon Bedrock AgentCore, from…☆17Updated this week
- ☆16Dec 23, 2024Updated last year
- A fun little Three.js experiment☆13Dec 17, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A plug-and-play SwiftUI package for animated hand-drawn text, glyphs, and font authoring — by Jip van der Velde and Michel Elings, creato…☆94Sep 3, 2026Updated 2 months ago
- Simple flight simulator☆17May 7, 2026Updated 6 months ago
- ☆17Sep 2, 2026Updated 2 months ago
- voting using blockchain technology☆11Apr 8, 2023Updated 3 years ago
- Hacker News Who is Hiring☆15Sep 5, 2026Updated 2 months ago
- PoC of TSS in Solana blockchain☆53Jun 19, 2022Updated 4 years ago
- ☆15Feb 15, 2025Updated last year
- 🛡️ Your infrastructure's immune system — detect IaC drift, attribute blame with CloudTrail audit logs, and auto-remediate with PRs. Buil…☆16Oct 25, 2026Updated 2 weeks ago
- ☆21Dec 10, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repo accompanies our blogpost titled "How to Write a Custom Terraform Provider Automatically with OpenAPI"☆15Apr 20, 2022Updated 4 years ago
- DNS server and resolver implemented in the Go☆35Jun 9, 2023Updated 3 years ago
- ☆11Nov 20, 2019Updated 6 years ago
- Turn ad scripts into production-ready prompts for GPT-image-2, Omni, Kling 3.0, Seedance 2.0/2.5. Single HTML file, bring your own Anthro…☆22Aug 13, 2026Updated 2 months ago
- Make AI writing sound like you, not like AI. Two Claude Code skills that audit text against your own voice and fix only what fails.☆21Aug 6, 2026Updated 3 months ago
- It will contains all the assignment of DSA Bootcamps☆11Nov 6, 2021Updated 5 years ago
- python script for generating wallpapers☆14May 17, 2023Updated 3 years ago
Are these results useful?