A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.
☆87Mar 4, 2026Updated this week
Alternatives and similar repositories for xllm-service
Users that are interested in xllm-service are comparing it to the libraries listed below
Sorting:
- Process Orchestration Framework: A camunda 7 fork☆21Updated this week
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆64Feb 12, 2026Updated 3 weeks ago
- Advanced block device testing/file system testing, targetting SNIA compatible reporting☆12Oct 15, 2025Updated 4 months ago
- Python wrappers for the FirecREST API☆12Dec 23, 2025Updated 2 months ago
- Lustre Repository with MS patches☆13Feb 28, 2026Updated last week
- Generate simple index ranges in C++ and CUDA C++☆39Jun 14, 2023Updated 2 years ago
- extended benchmarking automation tool for HPC applications☆16Feb 28, 2026Updated last week
- Cloyster HPC is a turnkey HPC cluster solution with an user-friendly installer☆10Oct 2, 2025Updated 5 months ago
- https://icml.cc/virtual/2023/poster/24354☆10Aug 15, 2023Updated 2 years ago
- Auto detection of apt proxies in the LAN, caching and checking status☆10Feb 13, 2025Updated last year
- Lustre HSM tools☆10Feb 19, 2024Updated 2 years ago
- Slurm job script archival☆12Updated this week
- Oracle Berkeley DB 18.x (Private copy of official distribution)☆11Jul 23, 2020Updated 5 years ago
- SQLite FTS5 中文单字分词器。☆10Apr 11, 2022Updated 3 years ago
- Utilities to support interacting with multiple HPC clusters☆11Nov 21, 2025Updated 3 months ago
- ☆10Jul 9, 2020Updated 5 years ago
- ☆22Oct 30, 2024Updated last year
- Tool to profile usage of HPC resources by regularly probing processes.☆11Updated this week
- ffmpeg+NCNN+QT视频人像抠图模型Intel CPU部署实时编解码☆10Apr 2, 2022Updated 3 years ago
- Collection of my personal helper scripts.☆14Dec 23, 2025Updated 2 months ago
- Composable Data and Type Generators for C++☆10Mar 25, 2019Updated 6 years ago
- Small wrapper to enable running arbitrary docker run commands in nomad.☆10Oct 28, 2017Updated 8 years ago
- Automatic Parallelism Using LLVM☆10Aug 2, 2014Updated 11 years ago
- Export files of iTunes Backup☆11Jul 16, 2022Updated 3 years ago
- cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容☆12Jul 25, 2022Updated 3 years ago
- animals 是一个对 boost.beast 的更高层次抽象实现，增加常用的功能如ssl，url, socks/http代理等支持，以更易于使用为目标。☆11Nov 11, 2023Updated 2 years ago
- ☆13Mar 3, 2025Updated last year
- ☆47Jun 24, 2025Updated 8 months ago
- ☆11Jan 19, 2025Updated last year
- Telegram bot which knows IPv6 excuses.☆11Mar 24, 2018Updated 7 years ago
- ☆15Mar 4, 2017Updated 9 years ago
- Cross-platform process dependency monitor with GUI☆10Feb 23, 2026Updated last week
- mobileNet SSD 基于caffe的前向检测☆10Nov 30, 2018Updated 7 years ago
- ☆12Mar 13, 2023Updated 2 years ago
- Very small standalone full-text search HTTP/SCGI server☆14Jun 11, 2025Updated 8 months ago
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago
- Repository for the paper "T5APR: Empowering Automated Program Repair across Languages through Checkpoint Ensemble."☆11Oct 23, 2025Updated 4 months ago
- A minimalist deep research framework for any OpenAI API compatible LLMs.☆14Nov 3, 2025Updated 4 months ago
- Realtime metrics server written in Go☆12Apr 8, 2025Updated 10 months ago