☆48Sep 7, 2024Updated last year
Alternatives and similar repositories for LLMServingPerfEvaluator
Users that are interested in LLMServingPerfEvaluator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FMO (Friendli Model Optimizer)☆14Jan 8, 2025Updated last year
- Welcome to PeriFlow CLI ☁︎☆12Aug 3, 2023Updated 2 years ago
- [⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI☆50Jun 25, 2025Updated 10 months ago
- MIST: High-performance IoT Stream Processing☆18Mar 19, 2019Updated 7 years ago
- Cruise: A Distributed Machine Learning Framework with Automatic System Configuration☆26Mar 19, 2019Updated 7 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Apache Nemo (Incubating) - Data Processing System for Flexible Employment With Different Deployment Characteristics☆114Jul 1, 2025Updated 10 months ago
- ☆15Jun 8, 2021Updated 4 years ago
- Mirror of Apache REEF☆99Jul 6, 2022Updated 3 years ago
- ☆18Dec 4, 2017Updated 8 years ago
- Ethereum VM fuzzer☆62Jul 14, 2021Updated 4 years ago
- Dotfile management with bare git☆22Mar 14, 2026Updated last month
- A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.☆130Feb 21, 2022Updated 4 years ago
- Lightweight and Parallel Deep Learning Framework☆262Nov 26, 2022Updated 3 years ago
- ☆24Nov 24, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 컴퓨터 신기술 특강☆13Dec 22, 2018Updated 7 years ago
- Example and helpers for building rust projects under cmake☆16Oct 5, 2018Updated 7 years ago
- ☆20Jul 24, 2024Updated last year
- AI Agent who manages your Jira project☆21Jun 23, 2024Updated last year
- Alkali is a MLIR-based compiler infrastructure for SmartNICs. It allows developers to write target-independent programs, with the compile…☆30Sep 28, 2025Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 14, 2025Updated 5 months ago
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆125Jul 4, 2025Updated 10 months ago
- This projects aims to show how whisper model can be fine-tuned on language it was not trained but is trained on similar language to it.☆11May 10, 2024Updated 2 years ago
- NVIDIA Riva SDK Demonstration for Feb 2022,2023 Developer Meetup☆10Jan 11, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Cross Platform Socket Library☆12Jul 9, 2017Updated 8 years ago
- ☆11Dec 8, 2022Updated 3 years ago
- Nexusflow function call, tool use, and agent benchmarks.☆30Dec 13, 2024Updated last year
- ☆13Jan 23, 2021Updated 5 years ago
- Prototypes and experiments for WG Device Management.☆15Apr 1, 2026Updated last month
- ☆18Dec 3, 2020Updated 5 years ago
- A repository for Kustomize manifests☆13Aug 19, 2024Updated last year
- A class for synchronizing sensor readings to the system clock☆11Oct 25, 2018Updated 7 years ago
- Javelin is a dialect of Lisp. It is designed to be an embedded language (minimal Lisp for the Java Virtual Machine).☆30Oct 4, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Mirror of git://android.git.kernel.org/platform/frameworks/base.git with TaintDroid additions (Mirror lags official Android)☆35Mar 26, 2016Updated 10 years ago
- Transformer Encoder with Char information for text classification☆15Jan 17, 2020Updated 6 years ago
- A Benchmark Harness for Systematic and Robust Evaluation of Streaming State Stores☆17Apr 24, 2024Updated 2 years ago
- Neovim theme with warm contrast (Nightingale & Lightingale)☆31Updated this week
- A python package for midi clip ✂️☆18Jun 5, 2023Updated 2 years ago
- A collection of popular datasets for deep learning.☆31Dec 9, 2022Updated 3 years ago
- 모두의 말뭉치 인공 지능 언어 능력 평가 1등 솔루션입니다.☆49Nov 20, 2021Updated 4 years ago