LLM-Inference-Bench
☆60Jul 18, 2025Updated 8 months ago
Alternatives and similar repositories for LLM-Inference-Bench
Users that are interested in LLM-Inference-Bench are comparing it to the libraries listed below
Sorting:
- Simulating Distributed Training at Scale☆14Sep 15, 2025Updated 6 months ago
- ☆16Feb 5, 2024Updated 2 years ago
- Reference implementation for the climate segmentation benchmark, based on the Exascale Deep Learning for Climate Analytics work☆10May 6, 2020Updated 5 years ago
- A collection of reproducible inference engine benchmarks☆38Apr 22, 2025Updated 11 months ago
- Parse CMake files with Python☆13Updated this week
- AI Workload Orchestrator for Kubernetes☆21Updated this week
- 关于深度学习算法、框架、编译器、加速器的一些理解☆16Jul 2, 2022Updated 3 years ago
- A GPU performance prediction toolkit for CUDA programs☆19Mar 25, 2019Updated 6 years ago
- 🚀 Automated deployment stack for AMD MI300 GPUs with optimized ML/DL frameworks and HPC-ready configurations☆12Nov 30, 2024Updated last year
- Development containers for triton and triton-cpu☆24Mar 9, 2026Updated last week
- Command Line Interface for running 🤗 Transformers Image Classification locally☆19May 8, 2025Updated 10 months ago
- PilotFish harvests the free GPU cycles of cloud gaming with deep learning training☆14Jul 2, 2022Updated 3 years ago
- ☆10Dec 8, 2021Updated 4 years ago
- Python tool for batch visual question answering (BVQA).☆14Sep 18, 2025Updated 6 months ago
- A C++based implementation of the TeaLeaf heat conduction mini-app. This implementation of TeaLeaf replicates the functionality of the ref…☆25Aug 11, 2024Updated last year
- Flux tutorial slides and materials☆25Mar 11, 2026Updated last week
- Repo for climate deep learning codes☆16May 21, 2019Updated 6 years ago
- This repository contains code for the paper Direct Preference Optimization with an Offset (ODPO).☆18Feb 17, 2025Updated last year
- Offline optimization of your disaggregated Dynamo graph☆227Updated this week
- This repository contains experimental tools we developed to forecast a clusters' resource (CPU or memory) usage.☆44Apr 28, 2021Updated 4 years ago
- Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.☆57Mar 4, 2026Updated 2 weeks ago
- ☆38May 23, 2025Updated 9 months ago
- ☆30Mar 2, 2026Updated 2 weeks ago
- ☆13Dec 8, 2022Updated 3 years ago
- Advanced job scheduling simulator☆18Nov 6, 2023Updated 2 years ago
- ☆37Mar 10, 2026Updated last week
- Special Topics in AI: Artificial Intelligence as an Archival Science☆20May 13, 2024Updated last year
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13May 17, 2025Updated 10 months ago
- vLLM Daily Summarization of Merged PRs☆48Updated this week
- ☆11May 24, 2024Updated last year
- A context-aware embedding similarity score☆11Aug 23, 2023Updated 2 years ago
- SmartTLS is the project introduced at the paper "A Case for SmartNIC-accelerated Private Communication" (APNET 20). It accelerates web se…☆17Feb 20, 2025Updated last year
- ☆77Dec 29, 2025Updated 2 months ago
- ☆32Apr 19, 2025Updated 11 months ago
- LaTeX template for dissertation proposals in Peking University Shenzhen.☆15Feb 23, 2022Updated 4 years ago
- ☆33Updated this week
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆25Oct 11, 2025Updated 5 months ago
- distill large scale web page text☆12Jul 29, 2023Updated 2 years ago
- ☆24Nov 22, 2020Updated 5 years ago