Distributed Inference with vLLM
☆13Jul 18, 2026Updated 3 months ago
Alternatives and similar repositories for distributed-inference-vllm
Users that are interested in distributed-inference-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local Agentic Model Deployment on AI Cluster☆22Nov 6, 2026Updated last week
- Kempner Institute Computing Handbook☆62Nov 6, 2026Updated last week
- PyTorch-native framework for fault-tolerant distributed training of foundation models on AI clusters☆25Updated this week
- NVIDIA HPC Benchmarks☆13Apr 8, 2026Updated 7 months ago
- Find Best SLURM Partition to Run a Job☆14Oct 20, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KempnerPulse - real-time GPU monitoring dashboard for DCGM metrics.☆44Aug 25, 2026Updated 2 months ago
- Matching on generalized propensity scores with continuous exposures☆27Jan 12, 2026Updated 10 months ago
- Learn about designing and training LLM Agents from Colab Notebooks☆20Jun 6, 2025Updated last year
- CLEF: Controllable Sequence Editing for Biological and Clinical Trajectories☆13Mar 15, 2026Updated 7 months ago
- ☆19Mar 5, 2026Updated 8 months ago
- Materials and code for Harvard DataFest workshop☆37Dec 16, 2021Updated 4 years ago
- Final project for the class "Deep Learning Systems Algorithms and Implementation" from CMU, where we try to make needle work with Apple M…☆11Jan 8, 2023Updated 3 years ago
- ☆24Aug 13, 2026Updated 3 months ago
- Dask Tutorial by Coiled☆17Jul 7, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Rcpp, foreach, and doParallel: Using an Rcpp Function inside a parallel region created by doParallel and foreach☆10Jun 26, 2026Updated 4 months ago
- The Causal Rule Ensemble Method☆16Oct 20, 2024Updated 2 years ago
- PyTorch implementation of Group Normalization https://arxiv.org/abs/1803.08494☆13Mar 23, 2018Updated 8 years ago
- A modular system for personalized learning exploration.☆19Oct 10, 2025Updated last year
- ☆17Mar 17, 2023Updated 3 years ago
- CRAN Task View: Reproducible Research☆19Aug 5, 2026Updated 3 months ago
- ☆24May 23, 2026Updated 5 months ago
- Topological data analysis tools for cross correlation matrices☆39Sep 13, 2023Updated 3 years ago
- Country adjacency datasets☆12Nov 29, 2013Updated 12 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repository contains the results and code for the MLPerf™ Training v3.1 benchmark.☆17Jan 14, 2025Updated last year
- DeepSeek-V3, R1 671B on 8xH100 Throughput Benchmarks☆22Mar 13, 2025Updated last year
- A `dbt` project to analyze data snapshots from OpenAlex☆13Apr 13, 2024Updated 2 years ago
- ACL 2024 (SRW), Official Codebase of our Paper: "MoExtend: Tuning New Experts for Modality and Task Extension"☆15Dec 3, 2024Updated last year
- 💪 Visualize Fitbod export data.☆10Feb 10, 2022Updated 4 years ago
- A WDI system for labelling and extracting skills within job postings. Implements an entire intelligent system utilizing a front end, pull…☆14Apr 13, 2018Updated 8 years ago
- ☆17Dec 12, 2019Updated 6 years ago
- Various scripts for Stata☆13Dec 2, 2016Updated 9 years ago
- PyTorch implementation for OD-cheap-convolution.☆20Sep 29, 2019Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SpaCE, the Spatial Confounding Environment, loads benchmark datasets for causal inference methods tackling spatial confounding☆19Jun 28, 2025Updated last year
- pytorch implementation of "Contrastive Multiview Coding", "Momentum Contrast for Unsupervised Visual Representation Learning", and "Unsup…☆18Mar 23, 2020Updated 6 years ago
- Exploring Feature Self-relation for Self-supervised Transformer (TPAMI 2023)☆21Apr 30, 2025Updated last year
- Getting a better understanding of Black-Litterman and how Betterment manages my ETF portfolio.☆15Jul 29, 2015Updated 11 years ago
- Pytorch code for paper: Full-Stack Filters to Build Minimum Viable CNNs☆16Sep 10, 2019Updated 7 years ago
- ☆24Jun 29, 2026Updated 4 months ago
- A tool to scrape the faculty details of QS Top 30 Institutes.☆12Sep 20, 2022Updated 4 years ago
Are these results useful?