A unified workflow orchestration and distributed KV cache sharing framework for multimodal inference.
☆38Sep 4, 2026Updated last month
Alternatives and similar repositories for omni-flow
Users that are interested in omni-flow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆19Oct 9, 2026Updated last week
- Autonomous CUDA kernel optimization agent with structured task specs and per-config scoring☆17Jun 17, 2026Updated 4 months ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 6 months ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- ☆46Oct 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages☆201Updated this week
- Real-time airspace surveillance, orbital tracking, and spatial-temporal anomaly detection over live multi-source ADS-B data. Django/Chann…☆24Aug 9, 2026Updated 2 months ago
- A Feishu/Lark AI agent bot☆16Feb 27, 2026Updated 7 months ago
- A collection of megakernels for TPU☆167Updated this week
- A fault-tolerant distributed message queue system inspired by Kafka, with priority messaging, replication, and real-time monitoring.☆14Aug 15, 2025Updated last year
- An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.☆37Jul 21, 2026Updated 3 months ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆36May 22, 2026Updated 5 months ago
- QBitcoin is a quantum-resistant blockchain built from scratch using Falcon-512. Designed to secure digital assets in the post-quantum er…☆13May 24, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An agent for CUDA compute-communication kernel co-design☆37May 7, 2026Updated 5 months ago
- Automatic formal verification for warp-specialized GPU kernels.☆62Updated this week
- [AFK] Hardware router in Chisel (THU Network Joint Lab 2020)☆14Oct 8, 2020Updated 6 years ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆38Jul 12, 2026Updated 3 months ago
- Easy, Fast, and Scalable Multimodal AI☆133Jun 2, 2026Updated 4 months ago
- ☆87Updated this week
- ☆86Jul 27, 2026Updated 2 months ago
- High-Throughput Batch Inference☆18Updated this week
- AWS Dev enviroment☆22May 20, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆33Aug 6, 2026Updated 2 months ago
- Community-driven benchmark suite for MLX inference engines on Apple Silicon☆25Oct 11, 2026Updated last week
- Strongly typed MCP tools in Swift☆11Sep 13, 2026Updated last month
- A software pipeline to decode the Falcon 9 telemetry from the 6MS/s baseband file.☆16Mar 31, 2021Updated 5 years ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆106Apr 7, 2026Updated 6 months ago
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 4 years ago
- In-Memory Key-Value Store Live Migration with NetMigrate☆19Jun 22, 2024Updated 2 years ago
- An agentic system that auto-optimizes LLM workloads on AMD GPUs.☆249Updated this week
- Design & optimization of Feather, an ultra-lightweight 1-meter hand-launched RC glider☆12Jul 22, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆17May 10, 2024Updated 2 years ago
- Lightweight Benchmark Server for Agentic GPU Programming☆58Updated this week
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆24Aug 5, 2026Updated 2 months ago
- Pure-Rust WebGPU inference engine for GGUF models. No C++, no Python, no llama.cpp. Runs on NVIDIA, AMD, Intel, and Apple Silicon.☆20Updated this week
- Unofficial ontologies for Official Registers of Russian Federal Tax Service☆12Apr 7, 2018Updated 8 years ago
- A juicy token compression algorithm. Compress upto 95% of tokens without any loss. Free & Opensource☆21Updated this week
- This repository hosts the official project files of Team J.E.E.P. from the Philippines for the FE competition in WRO 2025, detailing thei…☆301Nov 28, 2025Updated 10 months ago