This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
☆57Sep 22, 2026Updated this week
Alternatives and similar repositories for ci-infra
Users that are interested in ci-infra are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.☆12Jul 24, 2025Updated last year
- Parallel git worktrees for parallel AI agents — plus AI-generated commits.☆28Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.☆58Updated this week
- ☆16Sep 4, 2023Updated 3 years ago
- Splice two UDP sockets in kernel space to get the best performance☆11Oct 22, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- TPU inference for vLLM, with unified JAX and PyTorch support.☆438Updated this week
- A high-performance and light-weight router for vLLM large scale deployment☆433Updated this week
- vLLM Daily Summarization of Merged PRs☆54Updated this week
- ☆47Aug 16, 2026Updated last month
- An Empirical Study of Memorization in NLP (ACL 2022)☆13Jun 22, 2022Updated 4 years ago
- ☆461Aug 26, 2026Updated 3 weeks ago
- demonstration for our ACL 2018 paper, "On the Practical Computational Power of Finite Precision RNNs for Language Recognition"☆11May 26, 2019Updated 7 years ago
- Demonstration of using Caffe2 inside an Android application.☆10Dec 23, 2018Updated 7 years ago
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,635Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source code and data for the EDM 2022 paper☆12May 16, 2022Updated 4 years ago
- ☆16Aug 19, 2024Updated 2 years ago
- Unifew: Unified Fewshot Learning Model☆18Sep 10, 2021Updated 5 years ago
- Implementation of the first neural natural logic paper on natural language inference☆10Oct 31, 2022Updated 3 years ago
- [AAAI 2025] Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems☆13May 5, 2025Updated last year
- Linear Algebra for Machine Learning Book Exercises☆13May 19, 2019Updated 7 years ago
- Resource scheduling and cluster management for AI☆15Jun 29, 2023Updated 3 years ago
- Tool for tagging FLV files☆12Nov 2, 2015Updated 10 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- self-hosted github runners☆18Updated this week
- ☆23May 10, 2023Updated 3 years ago
- Benchmark to measure what the real knowledge cutoff of a model is☆21Sep 2, 2026Updated 2 weeks ago
- unblocked web browser for school☆10Dec 17, 2021Updated 4 years ago
- Prolog interpreter with support for weak unification. Fork of https://bitbucket.org/cfbolz/pyrolog/☆15Jun 23, 2020Updated 6 years ago
- Fused multiply-add (with a single rounding) for Python.☆21Aug 14, 2024Updated 2 years ago
- Source code for Findings of EMNLP 2021 paper ``Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning``☆13Nov 9, 2021Updated 4 years ago
- Code for modeling attention network for distant supervised relation extraction (CoNLL 2019).☆15Feb 28, 2020Updated 6 years ago
- A very simple tool to rewrite parameters such as attributes and constants for OPs in ONNX models. Simple Attribute and Constant Modifier …☆15Feb 6, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Oct 2, 2025Updated 11 months ago
- Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking☆13Feb 5, 2023Updated 3 years ago
- MLIR-based TileLang Ascend Adapter☆27Updated this week
- Distributed ML Optimizer☆35Jul 28, 2021Updated 5 years ago
- A list of research resources that I've appreciated.☆12Dec 10, 2019Updated 6 years ago
- NVIDIA driver packaging for Ubuntu☆18Mar 23, 2021Updated 5 years ago
- 🔥Keywords and URLs Censored on the Chinese Internet☆13Feb 22, 2020Updated 6 years ago