Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
☆28Jun 28, 2023Updated 3 years ago
Alternatives and similar repositories for inference-benchmark
Users that are interested in inference-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sentence Embedding as a Service☆15Jun 30, 2025Updated last year
- Distributed DRL by Ray and TensorFlow Tutorial.☆10Dec 26, 2019Updated 6 years ago
- Cloud Native Machine Learning Model Registry☆81Jan 12, 2023Updated 3 years ago
- Model factory is a ML training platform to help engineers to build ML models at scale☆18Sep 27, 2021Updated 5 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆10Jul 31, 2024Updated 2 years ago
- 一个批量下载人人网相册照片的工具。☆11Nov 15, 2018Updated 8 years ago
- ☆127Jun 25, 2026Updated 4 months ago
- Testing effects of the Go CPU profiler on microbenchmarks☆13Aug 31, 2022Updated 4 years ago
- ☆30Jun 15, 2021Updated 5 years ago
- The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".☆12Oct 25, 2021Updated 5 years ago
- 应用系统体系架构☆23Dec 1, 2023Updated 2 years ago
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 4 years ago
- A throughput benchmarking tool for network topologies☆11Nov 22, 2016Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Neutron plugins for Ironic/Neutron integration. Mirror of code maintained at opendev.org.☆11Updated this week
- Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"☆12Aug 17, 2021Updated 5 years ago
- Looking and Listening: Audio Guided Text Recognition☆10Jun 7, 2023Updated 3 years ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆905Nov 2, 2026Updated 2 weeks ago
- A general-purpose GPU monitor, witch can monitor GPU cards and the usage of each pods or containers.☆21Mar 8, 2022Updated 4 years ago
- ☆10Jan 20, 2024Updated 2 years ago
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆33May 19, 2023Updated 3 years ago
- NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that del…☆26Jul 21, 2023Updated 3 years ago
- 非沪籍高校毕业生留沪各项流程汇总☆17Jan 24, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PEP-DNA: a Performance Enhancing Proxy for Deploying Network Architectures☆11Jun 19, 2024Updated 2 years ago
- OpenSFEDS, a near-eye gaze estimation dataset containing approximately 2M synthetic camera-photosensor image pairs sampled at 500 Hz unde…☆12Apr 18, 2024Updated 2 years ago
- [ACL'26 Oral] Official implementation of "SegTune: Structured and Fine-Grained Control for Song Generation".☆19Jun 5, 2026Updated 5 months ago
- Library for the Test-based Calibration Error (TCE) metric to quantify the degree to classifier calibration.☆13Sep 15, 2023Updated 3 years ago
- Code and pre-trained model release for the ICASSP 2023 Paper "NORD NON-MATCHING REFERENCE BASED RELATIVE DEPTH ESTIMATION FROM BINAURAL A…☆11May 5, 2024Updated 2 years ago
- DEPRECATED. see github.com/ccp-project/portus☆10Dec 31, 2018Updated 7 years ago
- Midas is a memory management system that efficiently and safely harvests idle memory for applications' soft state.☆13Oct 30, 2024Updated 2 years ago
- FlowBundler is a high-speed software shaping scheme☆11Jan 17, 2025Updated last year
- A Basic Flink Application Consuming & Aggregating Kafka Messages☆10Nov 8, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆273Oct 11, 2023Updated 3 years ago
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated 2 years ago
- MQ-ECN NS2 Simulation☆11Feb 26, 2016Updated 10 years ago
- QJump NS patches and driver scripts☆12Jun 29, 2015Updated 11 years ago
- ML-Based behavioral endpoint detection system for Linux machines☆12Oct 1, 2026Updated last month
- ☆17Jul 24, 2023Updated 3 years ago
- Latency and Memory Analysis of Transformer Models for Training and Inference☆497Apr 19, 2025Updated last year
Are these results useful?