A high-throughput and memory-efficient inference and serving engine for LLMs
☆35Jul 9, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Jul 5, 2026Updated 3 weeks ago
- Elyan Labs — Hartford AI Day Pitch Deck☆32Jun 10, 2026Updated last month
- The wolfSSL library is a small, fast, portable implementation of TLS/SSL for embedded devices to the cloud. wolfSSL supports up to TLS 1…☆34May 18, 2026Updated 2 months ago
- Open source library for N64 development.☆33May 18, 2026Updated 2 months ago
- A list of open source games.☆31Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A list of Game Development resources to make magic happen.☆31May 18, 2026Updated 2 months ago
- LLM inference in C/C++☆32Mar 28, 2026Updated 4 months ago
- TLS/SSL and crypto library☆33Mar 16, 2026Updated 4 months ago
- Mine RTC while playing retro games on Raspberry Pi. RetroAchievements integration, Proof of Play, Cartridge Relics, Saturday Morning Ques…☆37Jul 25, 2026Updated last week
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆30Mar 21, 2026Updated 4 months ago
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆26Jul 10, 2026Updated 3 weeks ago
- A fast, compressed, persistent binary data store library for C.☆35May 18, 2026Updated 2 months ago
- Météo-France's AI Python package☆41May 18, 2026Updated 2 months ago
- Heavily optimized library for DEFLATE/zlib/gzip compression and decompression☆35Mar 16, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES (vcipher) + AltiVec vec_perm. Hebbian path selection, cross-hea…☆39Jun 24, 2026Updated last month
- openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.☆36Mar 11, 2026Updated 4 months ago
- The official firmware for Meshtastic, an open-source, off-grid mesh communication system.☆36Updated this week
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.☆38Updated this week
- An Ergo-Appkit based library providing an abstraction layer to easily interact with AVL Trees as an L2 Solution☆34Updated this week
- ☆40May 18, 2026Updated 2 months ago
- RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine…☆39Jul 25, 2026Updated last week
- A marketplace for AI-assisted engineers and skilled workers.☆25May 18, 2026Updated 2 months ago
- A curated list of AI video generation tools - text-to-video, avatars, UGC ads, lip sync, and open source models.☆41Apr 28, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A VS Code extension that collapses long Tailwind CSS class strings to keep your templates clean and readable. Includes a Tailwind CSS pre…☆33May 20, 2026Updated 2 months ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆28Apr 12, 2026Updated 3 months ago
- The Linux perf GUI for performance analysis.☆32Mar 18, 2026Updated 4 months ago
- A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring…☆24Updated this week
- Capstone disassembly/disassembler framework for ARM, ARM64 (ARMv8), Alpha, BPF, Ethereum VM, HPPA, LoongArch, M68K, M680X, Mips, MOS65XX,…☆33Apr 3, 2026Updated 4 months ago
- Elyan Labs Ecosystem Contributor Registry — every human, bot, and agent tracked with RTC wallets☆55Jul 25, 2026Updated last week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆31May 15, 2026Updated 2 months ago
- Profile README — Elyan Labs. Every CPU has a voice.☆42Jul 25, 2026Updated last week
- an awesome list of decentralized services and technologies☆34Mar 16, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The Python programming language☆30Mar 18, 2026Updated 4 months ago
- The Next-gen Open Source learning platform for everyone ✨☆40Mar 18, 2026Updated 4 months ago
- Mirror of https://git.ffmpeg.org/ffmpeg.git☆30Mar 18, 2026Updated 4 months ago
- A curated list of modern Generative Artificial Intelligence projects and services☆34Updated this week
- A collection of free software and free culture resources for making amazing games. (mirror)☆33Updated this week
- HACL*, a formally verified cryptographic library written in F*☆31May 18, 2026Updated 2 months ago
- Collection of Games that have the source code available on GitHub☆36May 18, 2026Updated 2 months ago